-- Logs begin at Fri 2021-11-19 12:56:29 UTC, end at Fri 2021-11-19 13:55:18 UTC. -- Nov 19 13:27:52.267825 dv-cinder-817351-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 13:27:52.275348 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 13:27:52 2021] *** Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: nodename: dv-cinder-817351-4-iscsi Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: machine: x86_64 Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: clock source: unix Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: pcre jit disabled Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: detected number of CPU cores: 4 Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: current working directory: / Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: detected binary path: /usr/bin/uwsgi-core Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: your processes number limit is 47680 Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: your memory page size is 4096 bytes Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: detected max file descriptor number: 2048 Nov 19 13:27:52.277355 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: lock engine: pthread robust mutexes Nov 19 13:27:52.278296 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: thunder lock: enabled Nov 19 13:27:52.278296 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 13:27:52.278296 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 13:27:52.323084 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: Python main interpreter initialized at 0x55a64028f9c0 Nov 19 13:27:52.323084 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: python threads support enabled Nov 19 13:27:52.323084 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: your server socket listen backlog is limited to 100 connections Nov 19 13:27:52.323084 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: your mercy for graceful operations on workers is 90 seconds Nov 19 13:27:52.323475 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 13:27:52.323558 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: *** Operational MODE: preforking *** Nov 19 13:27:52.323831 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: *** uWSGI is running in multiple interpreter mode *** Nov 19 13:27:52.323831 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: spawned uWSGI master process (pid: 102127) Nov 19 13:27:52.324055 dv-cinder-817351-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 13:27:52.324981 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: spawned uWSGI worker 1 (pid: 102128, cores: 1) Nov 19 13:27:52.324981 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: spawned uWSGI worker 2 (pid: 102129, cores: 1) Nov 19 13:27:52.325319 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 13:27:53.946810 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:27:53.946810 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: from cryptography.utils import int_from_bytes Nov 19 13:27:53.947673 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:27:53.947673 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: from cryptography.utils import int_from_bytes Nov 19 13:27:53.947819 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:27:53.947819 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: from cryptography.utils import int_from_bytes Nov 19 13:27:53.947819 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:27:53.947819 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: from cryptography.utils import int_from_bytes Nov 19 13:27:56.435726 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 13:27:56.436265 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 13:27:56.436613 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 13:27:56.436711 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 13:27:56.436780 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 13:27:56.436851 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 13:27:56.436927 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 13:27:56.436993 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 13:27:56.437061 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 13:27:56.437125 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 13:27:56.437428 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.437557 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.437735 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.437826 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.438082 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.438212 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.438415 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.438554 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.438704 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.438801 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.439083 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.439265 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.439467 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.439594 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.439790 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440023 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440151 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440356 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440502 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440597 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440683 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.440929 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441056 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817351-4-iscsi {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441254 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817351-4-iscsi {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441383 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441579 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441708 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441858 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.441990 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.442197 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.442318 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.442447 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.442570 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.442767 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.442910 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.443074 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.443264 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.443468 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.443602 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444048 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444186 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444297 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444412 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444525 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444633 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444814 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.444957 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.445171 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.445273 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.445459 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.445550 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.445768 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.445855 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.446088 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.446180 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.446713 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.446810 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.447037 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.447186 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.447372 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.447509 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817351-4-iscsi {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.447773 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817351-4-iscsi {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.447905 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.448089 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.448212 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.448398 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.448521 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.448713 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.448836 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.449115 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.449230 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.449425 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.449548 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.449733 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.449856 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450055 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450179 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450360 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450481 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450673 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450807 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.450997 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.451145 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.451342 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.451480 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.451664 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.451797 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.451973 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.452105 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.452271 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.452393 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.452577 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.452706 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.452881 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453013 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453189 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453317 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453474 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453687 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453816 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.453934 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.454060 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.454182 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.454311 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.454429 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.454631 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.454867 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.455065 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.455282 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.455497 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.455624 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.455755 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.455876 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456002 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456135 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456259 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456376 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456501 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456627 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456753 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.456877 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.457062 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.457195 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.457373 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.457660 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.457794 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.457913 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458033 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458162 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458280 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458407 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458545 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458699 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458846 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.458969 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.459193 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.459327 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.459512 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.459667 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.459803 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.459992 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.460115 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.460315 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.460449 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.460710 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.460835 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.460955 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.461072 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.461260 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.461384 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.461602 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.461727 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.461924 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.462048 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.462233 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.462359 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.462557 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.462687 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.462876 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.463006 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.463208 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.463338 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.463517 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.463777 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.463902 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464033 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464165 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464329 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464451 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464573 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464741 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464873 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.464997 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465171 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465301 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465412 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465551 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465678 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465869 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.465992 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.466173 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.466309 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.466479 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.466618 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.466785 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.466907 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467067 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467251 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467399 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467551 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467745 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467866 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.467983 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.468102 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.468303 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.468429 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.468586 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.468717 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.468896 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469017 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469197 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469319 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469488 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469618 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469792 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.469909 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.470108 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.470234 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.470455 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.470602 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.470758 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.470879 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.471064 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.471220 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.471394 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.471522 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.471703 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.471835 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472025 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472152 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472329 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472448 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472635 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472755 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.472958 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.473087 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.473267 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.473387 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.473573 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.473692 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.473899 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474025 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474190 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474336 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474505 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474636 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474832 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.474952 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.475153 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.475279 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.475464 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.475596 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.475780 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.475900 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476085 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476203 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476393 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476520 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476695 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476812 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.476998 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.477156 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.477302 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.477433 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.477602 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.477743 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.477932 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478052 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478199 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478331 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478478 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478605 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478794 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.478913 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.479143 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.479303 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.479459 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.479578 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.479770 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.479889 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.480077 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.480197 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.480398 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.480516 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:27:56.480729 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.480854 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.481056 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.481177 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.481405 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.481530 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.481718 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.481845 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.482051 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.482172 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.482381 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.482506 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.482699 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.482825 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.483008 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.483160 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.483349 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.483473 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.483679 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.483811 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484019 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484153 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484300 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484419 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484609 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484735 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.484927 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.485046 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.485244 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.485372 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.485574 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.485716 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.485907 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.486033 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.486252 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.486373 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.486570 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.486701 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.486889 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.487009 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.487243 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.487375 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.487575 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.487707 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.487908 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.488099 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.488221 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.488352 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.488544 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.488665 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.488887 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489008 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489201 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489323 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489512 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489640 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489828 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.489978 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.490151 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.490283 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.490462 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.490583 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.490772 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.490901 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.491083 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.491257 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.491508 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.491630 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.491820 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.491946 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.492130 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.492257 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.492465 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.492588 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.492779 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.492898 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.493092 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.493219 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.493394 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.493513 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.493701 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.493834 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494007 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494215 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494337 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494453 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494609 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494729 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.494927 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.495053 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.495274 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.495393 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.495581 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.495693 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.495912 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496031 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496216 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496342 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496524 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496641 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496835 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.496955 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.497137 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.497255 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.497447 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.497565 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.497759 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.497878 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498136 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498263 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498380 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498504 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498678 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498799 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.498981 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.499124 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.499326 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.499463 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.499634 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.499753 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.499938 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500057 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500254 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500380 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500562 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500680 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500875 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.500999 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.501185 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.501317 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.501536 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.501662 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.501955 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.502091 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.502274 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.502409 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.502609 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.502729 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.502939 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.503059 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.503276 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.503399 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.503602 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.503721 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.503925 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504042 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504250 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504385 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504553 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504652 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504868 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.504962 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.505168 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.505270 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.505480 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.505573 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.505792 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.505915 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.506101 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.506221 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.506404 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.506522 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.506708 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.506834 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507011 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507172 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507340 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507460 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507646 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507773 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.507970 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508090 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508284 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508410 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508573 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508705 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508878 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.508998 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.509181 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.509308 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.509523 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.509654 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.509830 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.509948 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.510169 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.510295 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.510502 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.510622 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.510822 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.510949 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.511172 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.511297 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.511490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.511613 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.511808 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.511929 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.512121 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.512248 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.512436 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.512559 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.512751 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.512872 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.513069 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.513190 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.513389 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.513511 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.513701 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.513829 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514017 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514136 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514333 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514434 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514655 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514759 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.514964 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.515068 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.515306 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.515411 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.515614 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.515714 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.515930 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.516055 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.516267 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.516369 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.516597 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.516688 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.516912 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.517019 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.517299 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.517405 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.517591 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.517685 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.517906 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518010 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518214 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518306 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518522 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518616 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518832 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.518964 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.519162 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.519298 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.519482 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.519601 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.519793 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.519913 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.520113 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.520231 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.520421 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.520544 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.520740 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.520867 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521047 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521175 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521363 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521481 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521666 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521785 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.521977 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.522103 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.522303 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.522429 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.522635 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.522762 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.522945 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.523065 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.523284 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.523415 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.523597 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.523718 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.523908 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524044 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524220 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524350 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524546 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524674 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524822 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.524957 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.525129 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.525258 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.525440 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.525562 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.525755 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.525874 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526080 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526225 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526370 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526489 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526672 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526790 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.526986 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.527143 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.527319 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.527451 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.527622 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.527743 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.527924 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528045 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528232 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528352 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528556 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528659 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528869 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.528970 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.529192 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.529284 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.529505 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.529597 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.529809 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.529902 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.530109 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.530208 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.530429 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.530531 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.530735 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.530826 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.531037 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.531151 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.531363 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.531459 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.531663 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.531746 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.532005 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.532088 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.532313 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.532405 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.532612 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.532703 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.533013 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.533147 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.533419 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.533523 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.533734 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.533820 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.534049 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.534141 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.534359 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.534473 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.534775 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.534946 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535074 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535203 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535417 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535643 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535839 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535998 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.535998 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.536328 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.536541 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.536743 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.536924 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.537057 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.537225 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.537410 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.537618 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.537808 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.538000 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.538196 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.538381 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.538608 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.538899 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.539077 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.539309 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.539526 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.539713 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.539870 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.539993 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.540110 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.540233 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.540350 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.540350 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.540674 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.540857 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541046 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541231 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541405 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541583 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541783 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541960 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541960 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.541960 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.542489 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.542489 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.542851 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.542985 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.543325 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.543638 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.543945 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.544249 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.544554 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.544836 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.545143 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.545445 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.545794 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.546100 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.546435 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.546721 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.546845 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.547157 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.547325 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.547527 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.547651 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.547876 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.547961 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.548217 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.548323 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.548554 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.548756 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.548881 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.549202 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.549294 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.549528 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.549632 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.549847 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.549958 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.550164 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.550249 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.550481 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.550574 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.550800 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.550917 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.551138 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.551292 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.551454 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.551604 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.551809 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.551909 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.552125 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.552222 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.552459 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.552545 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.552772 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.552867 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.553090 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.553175 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.553402 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.553488 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.553716 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.553801 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.554025 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.554137 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.554341 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.554432 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.554777 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.554862 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.555134 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.555316 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.555513 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.555794 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.555880 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.556119 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.556204 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.556447 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.556602 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.556758 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.556845 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.557078 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.557165 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.557398 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.557502 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.557709 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.557801 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558025 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558108 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558339 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558424 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558652 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558740 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.558959 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559048 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559291 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559392 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559595 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559688 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559905 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.559990 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.560208 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.560306 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.560513 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.560597 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.560818 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.560905 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.561117 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.561209 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.561424 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.561508 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.561724 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.561814 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562037 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562131 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562344 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562428 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562647 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562738 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.562950 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563034 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563290 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563377 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563597 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563752 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563897 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.563983 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.564253 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.564414 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.564555 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.564770 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.564915 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.565131 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.565265 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.565447 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.565568 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.565772 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.565866 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.566083 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.566170 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.566397 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.566543 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.566740 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.566837 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567013 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567191 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567346 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567447 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567727 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567839 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.567939 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.568010 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.568255 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.568409 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.568583 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.568723 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.568867 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569001 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569159 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569372 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569529 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569677 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569811 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.569951 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570097 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570252 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570395 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570529 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570662 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570806 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.570939 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.571088 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.571579 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.571717 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.571849 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.571995 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.572128 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.572314 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.572467 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.572637 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.572789 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.572931 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.573075 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.573221 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.573378 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.573549 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.573699 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.573875 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574028 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574169 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574308 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574475 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574621 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574754 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.574898 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.575074 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.575314 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.575484 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.575619 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.575752 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.575971 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576106 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576236 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576370 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576503 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576646 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576788 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.576921 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.577062 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.577195 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.577326 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.577539 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.577739 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.577896 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578035 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578176 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578310 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578457 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578606 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578748 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.578897 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.579031 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.579203 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.579365 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.579583 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580021 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580162 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580303 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580445 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580445 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580719 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580855 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.580987 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581130 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581276 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581410 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581541 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581673 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581806 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.581938 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582078 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582211 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582351 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582629 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582762 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.582914 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583062 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583223 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583414 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583559 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583727 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583874 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.583999 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.584167 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.584298 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.584443 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.584625 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.584762 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.584939 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.585076 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.585230 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.585366 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.585509 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.585680 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.585807 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586003 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586134 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586328 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586473 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586631 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586762 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.586948 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.587046 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.587264 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.587449 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.587595 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.587731 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.587866 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588038 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588233 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588373 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588541 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588683 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588854 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.588993 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.589135 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.589268 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.589445 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.589601 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.589807 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.589954 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590098 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590233 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590365 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590497 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590628 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590771 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.590969 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.591208 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.591363 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.591502 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.591642 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.591774 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.591937 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.592077 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.592239 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.592423 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.592563 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.592744 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.592888 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593060 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593207 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593393 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593539 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593682 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593814 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.593986 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.594125 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.594304 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.594444 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.594607 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.594765 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.594899 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.595036 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.595270 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.595576 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.595837 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596003 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596139 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596279 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596411 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596558 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596697 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.596831 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597060 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597206 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597340 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597592 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597764 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.597895 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598074 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598204 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598350 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598447 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598680 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598811 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.598981 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.599153 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.599330 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.599461 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.599645 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.599777 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.599910 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.600019 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.600246 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.600378 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.600523 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.600626 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.600873 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601005 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601188 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601333 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601482 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601573 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601792 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.601881 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.602101 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.602199 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.602416 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.602506 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.602722 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.602815 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603024 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603168 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603378 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603478 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603682 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603772 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.603988 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604079 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604293 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604384 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604593 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604683 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604890 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.604982 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.605206 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.605303 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.605504 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.605593 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.605808 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.605906 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.606108 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.606204 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.606417 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.606504 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.606707 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.606796 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.607002 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.607089 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.607336 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.607449 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.607637 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.607735 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608000 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608096 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608258 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608359 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608574 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608658 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608888 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.608973 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.609187 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.609282 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.609505 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.609590 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.609807 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.609891 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.610105 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.610203 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.610402 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.610488 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.610698 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.610783 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.611069 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.611192 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.611577 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.611682 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.611763 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.611943 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612039 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612279 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612366 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612592 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612676 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612895 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.612989 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.613198 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.613284 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.613521 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.613612 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.613826 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614097 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614192 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614271 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614448 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614535 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614747 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.614839 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.615046 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.615152 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.615374 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.615463 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.615678 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.615803 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616049 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616143 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616314 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616409 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616596 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616756 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.616908 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.617049 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.617221 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.617444 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.617607 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.617750 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.617897 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618040 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618179 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618337 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618486 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618634 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618788 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.618938 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619087 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619274 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619415 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619565 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619706 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619844 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.619983 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.620216 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.620362 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.620519 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.620661 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.620811 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.620951 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.621171 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.621314 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.621460 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.621600 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.621600 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.621866 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622014 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622159 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622300 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622439 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622589 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622737 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.622885 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623028 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623202 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623344 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623484 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623658 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623807 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.623975 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.624126 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.624277 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.624418 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.624583 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.624735 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.624888 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.625031 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.625175 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.625322 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.625522 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.625727 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.625874 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.626098 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.626260 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.626415 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.626617 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.626810 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.627023 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.627300 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.627559 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.627733 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.627876 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628018 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628158 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628311 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628537 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628680 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628832 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.628983 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629125 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629265 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629418 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629559 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629705 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629847 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.629987 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.630138 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.630411 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.630560 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.630729 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.630935 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631115 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631275 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631418 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631558 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631709 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631850 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.631990 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.632138 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.632283 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.632422 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.632572 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.632711 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.632858 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633007 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633158 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633300 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633439 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633595 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633743 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.633883 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634022 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634176 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634176 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634456 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634645 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634796 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.634949 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635105 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635264 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635416 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635557 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635704 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635844 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.635984 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.636122 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.636374 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.636521 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.636661 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.636809 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.636963 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637104 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637251 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637393 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637550 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637764 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637911 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.637911 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.638185 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.638334 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.638475 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.638613 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.638763 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.638920 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639069 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639267 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639420 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639562 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639701 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639848 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.639987 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.640139 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.640278 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.640498 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.640651 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.640805 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.640946 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641086 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641233 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641373 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641521 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641663 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641802 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.641941 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.642127 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.642401 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.642628 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.642869 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643043 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643216 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643359 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643516 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643653 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643653 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643823 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.643991 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644125 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644304 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644451 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644618 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644765 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644898 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.644995 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.645232 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.645376 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.645517 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.645613 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.645854 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.645997 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.646134 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.646231 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.646428 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.646528 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.646759 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.646902 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647068 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647206 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647378 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647510 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647664 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647756 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.647968 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648076 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648265 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648362 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648566 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648665 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648867 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.648958 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.649165 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.649264 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.649467 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.649564 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.649783 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.649873 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650083 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650175 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650380 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650478 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650690 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650780 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.650984 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.651073 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.651309 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.651414 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.651612 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.651702 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.651918 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652013 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652221 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652312 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652518 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652608 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652826 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.652916 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.653121 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.653220 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.653423 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.653512 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.653706 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.653792 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.654009 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.654298 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.654388 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.654615 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.654700 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.654912 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.655005 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.655230 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.655371 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.655540 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.655724 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.655843 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656038 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656158 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656353 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656468 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656669 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656837 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.656996 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.657081 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.657318 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.657404 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.657632 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.657930 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.658024 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.658292 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.658414 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.658603 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.658738 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.658938 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659106 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659292 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659378 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659593 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659691 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659892 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.659978 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.660190 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.660275 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.660505 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.660621 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.660811 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.660946 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.661113 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.661270 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.661415 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.661591 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.661719 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.661912 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662021 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662227 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662321 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662615 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662771 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662863 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.662953 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.663174 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.663280 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.663497 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.663596 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.663825 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.663924 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.664143 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.664257 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.664451 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.664536 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.664762 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.664868 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665069 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665183 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665373 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665506 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665677 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665833 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.665979 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.666145 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.666281 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.666482 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.666616 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.666796 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.666895 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.667142 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.667247 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.667454 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.667540 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.667772 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.667907 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.668109 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.668225 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.668454 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.668539 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.668786 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.668874 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.669114 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.669200 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.669423 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.669509 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.669731 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.669824 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670033 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670117 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670342 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670426 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670646 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670731 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.670970 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.671059 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.671323 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.671421 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.671647 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.671733 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.671961 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672048 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672267 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672369 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672573 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672659 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672875 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.672960 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.673181 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.673275 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.673565 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.673835 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.673947 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.674156 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.674262 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.674490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.674576 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.674795 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.674879 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.675120 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.675221 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.675424 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.675509 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.675740 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.675825 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676056 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676151 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676365 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676461 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676666 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676801 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.676991 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.677086 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.677294 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.677381 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.677797 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.677954 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678097 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678273 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678410 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678531 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678665 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678758 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678849 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.678929 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.679076 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.679195 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.679419 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.679505 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.679719 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.679824 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680043 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680129 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680354 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680453 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680669 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680755 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.680983 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.681068 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.681287 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.681386 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.681611 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.681696 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.681914 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682005 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682236 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682333 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682543 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682630 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682870 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.682957 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.683188 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.683282 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.683502 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.683590 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.683827 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.683918 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.684149 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.684235 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.684469 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.684560 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.684728 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 13:27:56.684813 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.685137 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.685445 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.685789 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.686120 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.686426 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.686734 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.687043 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:27:56.687294 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 13:27:56.708737 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_db.sqlalchemy.engines [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:56.710128 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_db.sqlalchemy.engines [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:56.783301 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.context [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa90e9eb-4700-48fd-b538-a6e9cc05f3ea(cell1) {{(pid=102129) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 13:27:56.789787 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:27:56.792709 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:27:56.793405 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:27:56.796600 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:27:56.798166 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.context [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa90e9eb-4700-48fd-b538-a6e9cc05f3ea(cell1) {{(pid=102128) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 13:27:56.802796 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_concurrency.lockutils [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:27:56.804443 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_concurrency.lockutils [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:27:56.805276 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_concurrency.lockutils [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:27:56.807347 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_concurrency.lockutils [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:27:56.808361 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_db.sqlalchemy.engines [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:56.811566 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_db.sqlalchemy.engines [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:56.821696 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_db.sqlalchemy.engines [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:56.824901 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_db.sqlalchemy.engines [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:57.070867 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_db.sqlalchemy.engines [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:57.083683 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG oslo_db.sqlalchemy.engines [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:27:57.420516 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: WARNING keystonemiddleware.auth_token [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:27:57.424606 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: WARNING keystonemiddleware.auth_token [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:27:57.427125 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: WARNING keystonemiddleware.auth_token [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:27:57.431085 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: WARNING keystonemiddleware.auth_token [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:27:57.646391 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: WARNING keystonemiddleware.auth_token [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:27:57.651455 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: WARNING keystonemiddleware.auth_token [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:27:57.651861 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: WARNING keystonemiddleware.auth_token [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:27:57.656658 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: WARNING keystonemiddleware.auth_token [None req-b2284d53-6067-407a-9ad3-a163fa841558 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:27:57.656928 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a64028f9c0 pid: 102128 (default app) Nov 19 13:27:57.659079 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:27:57.660285 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] 10.222.0.74 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Nov 19 13:27:57.662351 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 788 bytes} [Fri Nov 19 13:27:57 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:27:57.663249 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a64028f9c0 pid: 102129 (default app) Nov 19 13:29:21.028155 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:21.029187 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 19 13:29:21.029603 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:21.603465 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-fb8b5c0d-969c-4f4b-a450-cf6aaf00ccf2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:21.633654 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-fb8b5c0d-969c-4f4b-a450-cf6aaf00ccf2 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.594322 Nov 19 13:29:21.634463 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 1/3] 10.222.0.74 () {60 vars in 1291 bytes} [Fri Nov 19 13:29:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:29:24.037961 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:24.038961 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-26b3ee01-9931-4467-8b27-f5923a21a0e1 None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 19 13:29:24.039549 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 3/4] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:24.117521 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-c0eee09f-a45e-4d50-a779-d55c315e369f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:24.136874 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:29:24.136874 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: warnings.warn(msg) Nov 19 13:29:24.171709 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-c0eee09f-a45e-4d50-a779-d55c315e369f admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.125334 Nov 19 13:29:24.173462 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 2/5] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:24.540990 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-004568a9-60fe-4e00-8812-39a73fd41b29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:24.543490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:29:24.543490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: warnings.warn(msg) Nov 19 13:29:24.600531 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-004568a9-60fe-4e00-8812-39a73fd41b29 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.417900 Nov 19 13:29:24.601397 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 4/6] 10.222.0.74 () {64 vars in 1335 bytes} [Fri Nov 19 13:29:24 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:29:26.971474 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-c0eee09f-a45e-4d50-a779-d55c315e369f admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:26.972497 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-c0eee09f-a45e-4d50-a779-d55c315e369f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 Nov 19 13:29:26.975219 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 3/7] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:27.131613 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-926a2399-1d2c-40d6-8aa6-c97b5f46311a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "id": "d1", "swap": 0}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:27.151988 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:29:27.151988 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: warnings.warn(msg) Nov 19 13:29:27.175752 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-926a2399-1d2c-40d6-8aa6-c97b5f46311a admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.194893 Nov 19 13:29:27.183183 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 5/8] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:29:27.190023 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-0e43aba4-b873-44c8-8b1e-d72e664f1337 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:27.191725 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:29:27.191725 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: warnings.warn(msg) Nov 19 13:29:27.227563 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-0e43aba4-b873-44c8-8b1e-d72e664f1337 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041861 Nov 19 13:29:27.228265 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 4/9] 10.222.0.74 () {64 vars in 1335 bytes} [Fri Nov 19 13:29:27 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:29.607986 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-926a2399-1d2c-40d6-8aa6-c97b5f46311a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:29.609019 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-926a2399-1d2c-40d6-8aa6-c97b5f46311a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Nov 19 13:29:29.609382 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:29.678871 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-8cfe121b-4a29-4403-916a-f3bbd0ae5a59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:29.703529 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-8cfe121b-4a29-4403-916a-f3bbd0ae5a59 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086857 Nov 19 13:29:29.710951 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 5/11] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:29.718530 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-ef5751e6-cd9b-404f-9a6c-162546d31d01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:29.753996 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-ef5751e6-cd9b-404f-9a6c-162546d31d01 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039995 Nov 19 13:29:29.754692 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 7/12] 10.222.0.74 () {64 vars in 1335 bytes} [Fri Nov 19 13:29:29 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:29:32.121233 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-8cfe121b-4a29-4403-916a-f3bbd0ae5a59 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:32.122303 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-8cfe121b-4a29-4403-916a-f3bbd0ae5a59 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Nov 19 13:29:32.123024 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 6/13] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:32.185758 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-b6fc1669-b3c5-4cb7-9b72-a0f0c574ee18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:32.206738 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-b6fc1669-b3c5-4cb7-9b72-a0f0c574ee18 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075748 Nov 19 13:29:32.207413 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 8/14] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:32.221752 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-3f993c3a-e78a-4272-92ff-06ccd5131fc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:32.247688 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-3f993c3a-e78a-4272-92ff-06ccd5131fc7 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030408 Nov 19 13:29:32.248335 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 7/15] 10.222.0.74 () {64 vars in 1335 bytes} [Fri Nov 19 13:29:32 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:34.591010 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-b6fc1669-b3c5-4cb7-9b72-a0f0c574ee18 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:34.592063 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-b6fc1669-b3c5-4cb7-9b72-a0f0c574ee18 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Nov 19 13:29:34.592756 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 9/16] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:34.658320 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-19e82914-cd91-4e97-b2e7-490b60e80912 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "name": "ds4G"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:34.686901 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-19e82914-cd91-4e97-b2e7-490b60e80912 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086058 Nov 19 13:29:34.691592 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 8/17] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:34.708490 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-37e7f870-9165-43f3-80c1-af4eb02eedda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:34.748967 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-37e7f870-9165-43f3-80c1-af4eb02eedda admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046532 Nov 19 13:29:34.749967 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 10/18] 10.222.0.74 () {64 vars in 1335 bytes} [Fri Nov 19 13:29:34 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:37.242245 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-19e82914-cd91-4e97-b2e7-490b60e80912 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:37.243391 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-19e82914-cd91-4e97-b2e7-490b60e80912 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Nov 19 13:29:37.243791 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 9/19] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:37.329826 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-d8a9ad08-e95b-4b4a-89bb-ef99436c9563 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:37.356012 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-d8a9ad08-e95b-4b4a-89bb-ef99436c9563 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.103698 Nov 19 13:29:37.356918 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 11/20] 10.222.0.74 () {60 vars in 1291 bytes} [Fri Nov 19 13:29:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:29:39.717505 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-19e82914-cd91-4e97-b2e7-490b60e80912 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:39.718536 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-19e82914-cd91-4e97-b2e7-490b60e80912 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Nov 19 13:29:39.719037 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 10/21] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:39.795670 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-5d1cd7cc-194b-4898-bea8-b2a058a9d6b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:39.820678 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-5d1cd7cc-194b-4898-bea8-b2a058a9d6b2 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.094373 Nov 19 13:29:39.821403 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 12/22] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:39 2021] POST /compute/v2.1/flavors => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:39.833895 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-404b6adb-c5f9-495d-a9d2-e52bcc482336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:39.862026 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-404b6adb-c5f9-495d-a9d2-e52bcc482336 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031783 Nov 19 13:29:39.862823 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 11/23] 10.222.0.74 () {64 vars in 1332 bytes} [Fri Nov 19 13:29:39 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:42.341523 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-5d1cd7cc-194b-4898-bea8-b2a058a9d6b2 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:42.344750 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-5d1cd7cc-194b-4898-bea8-b2a058a9d6b2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004034 Nov 19 13:29:42.345582 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:42 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:42.406955 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-8a260dd5-889f-468b-8bba-f4da3a34fd6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "disk": 20}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:42.434516 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-8a260dd5-889f-468b-8bba-f4da3a34fd6a admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081201 Nov 19 13:29:42.435696 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 12/25] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:42 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:29:42.454051 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-e4c5571d-f292-4e13-bfba-0d8f4b9d779b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:42.494005 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-e4c5571d-f292-4e13-bfba-0d8f4b9d779b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047327 Nov 19 13:29:42.495314 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 14/26] 10.222.0.74 () {64 vars in 1332 bytes} [Fri Nov 19 13:29:42 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:44.862932 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-8a260dd5-889f-468b-8bba-f4da3a34fd6a admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:44.863980 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-8a260dd5-889f-468b-8bba-f4da3a34fd6a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Nov 19 13:29:44.864381 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 13/27] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:44.926150 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-89dccf86-3d4c-4b0e-b398-9744d7013295 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:44.946149 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-89dccf86-3d4c-4b0e-b398-9744d7013295 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075138 Nov 19 13:29:44.946770 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 15/28] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:44 2021] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:29:44.959362 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-0315ba4b-ae39-4582-9bdb-930f4111d7d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:44.983978 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-0315ba4b-ae39-4582-9bdb-930f4111d7d1 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028174 Nov 19 13:29:44.984582 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 14/29] 10.222.0.74 () {64 vars in 1332 bytes} [Fri Nov 19 13:29:44 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:47.359656 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-89dccf86-3d4c-4b0e-b398-9744d7013295 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:47.361028 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-89dccf86-3d4c-4b0e-b398-9744d7013295 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Nov 19 13:29:47.361438 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 16/30] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:47.429772 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b89f198e-47d7-4ada-b253-1e573efcd564 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "swap": 0, "name": "m1.large"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:47.453909 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b89f198e-47d7-4ada-b253-1e573efcd564 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085133 Nov 19 13:29:47.454464 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 15/31] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:47.467392 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-ea56a983-cb14-4cf3-9a64-788e151937a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:47.494106 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-ea56a983-cb14-4cf3-9a64-788e151937a1 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030392 Nov 19 13:29:47.494816 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 17/32] 10.222.0.74 () {64 vars in 1332 bytes} [Fri Nov 19 13:29:47 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:29:49.945027 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b89f198e-47d7-4ada-b253-1e573efcd564 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:29:49.945757 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b89f198e-47d7-4ada-b253-1e573efcd564 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Nov 19 13:29:49.959701 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 16/33] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:29:49 2021] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:29:50.051394 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-0672f277-d56d-441f-8e75-57980837b9c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:50.076450 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-0672f277-d56d-441f-8e75-57980837b9c6 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.119451 Nov 19 13:29:50.085350 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1282 bytes} [Fri Nov 19 13:29:49 2021] POST /compute/v2.1/flavors => generated 408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:29:50.095735 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-bf27bddf-1c5e-4572-a815-46e74ddcba42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:29:50.120607 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-bf27bddf-1c5e-4572-a815-46e74ddcba42 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030047 Nov 19 13:29:50.126884 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 17/35] 10.222.0.74 () {64 vars in 1332 bytes} [Fri Nov 19 13:29:50 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:30:11.664180 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-0672f277-d56d-441f-8e75-57980837b9c6 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:11.665705 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-0672f277-d56d-441f-8e75-57980837b9c6 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Nov 19 13:30:11.666084 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 19/36] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:30:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:11.739568 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-9df7a6c4-6864-4f8f-a6f2-dfd5c7370d89 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:11.757280 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-9df7a6c4-6864-4f8f-a6f2-dfd5c7370d89 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080093 Nov 19 13:30:11.757835 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1291 bytes} [Fri Nov 19 13:30:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:13.270882 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-0672f277-d56d-441f-8e75-57980837b9c6 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:13.271953 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-0672f277-d56d-441f-8e75-57980837b9c6 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Nov 19 13:30:13.272386 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 20/38] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:13.482924 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-e80e6ae4-786f-468f-a8e8-1fa214f317f0 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:13.489177 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.wsgi [None req-e80e6ae4-786f-468f-a8e8-1fa214f317f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 13:30:13.489744 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-e80e6ae4-786f-468f-a8e8-1fa214f317f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:30:13.490552 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-e80e6ae4-786f-468f-a8e8-1fa214f317f0 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073473 Nov 19 13:30:13.491053 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1190 bytes} [Fri Nov 19 13:30:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 13:30:13.501532 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-5d5346d8-1edc-465c-b307-358c17c7c193 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:13.522973 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-5d5346d8-1edc-465c-b307-358c17c7c193 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025097 Nov 19 13:30:13.523561 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 21/40] 10.222.0.74 () {60 vars in 1210 bytes} [Fri Nov 19 13:30:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:13.534087 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-e6c9fbca-971c-4288-a51e-04e106bf52dd admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:13.556891 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-e6c9fbca-971c-4288-a51e-04e106bf52dd admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026295 Nov 19 13:30:13.557456 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 20/41] 10.222.0.74 () {60 vars in 1210 bytes} [Fri Nov 19 13:30:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:13.568329 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-8b95e1f0-df1b-4d7c-a42f-fe8f53e001ae admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:13.574866 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.wsgi [None req-8b95e1f0-df1b-4d7c-a42f-fe8f53e001ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 13:30:13.575524 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-8b95e1f0-df1b-4d7c-a42f-fe8f53e001ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:30:13.576336 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-8b95e1f0-df1b-4d7c-a42f-fe8f53e001ae admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011849 Nov 19 13:30:13.576863 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 22/42] 10.222.0.74 () {60 vars in 1190 bytes} [Fri Nov 19 13:30:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 13:30:14.975846 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-e6c9fbca-971c-4288-a51e-04e106bf52dd admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:14.976887 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-e6c9fbca-971c-4288-a51e-04e106bf52dd admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 19 13:30:14.977280 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 21/43] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:15.178899 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-9b68b61b-f03b-4249-ac36-baf84d66e390 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:15.184922 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.wsgi [None req-9b68b61b-f03b-4249-ac36-baf84d66e390 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 13:30:15.185406 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-9b68b61b-f03b-4249-ac36-baf84d66e390 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:30:15.186184 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-9b68b61b-f03b-4249-ac36-baf84d66e390 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070279 Nov 19 13:30:15.186688 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 23/44] 10.222.0.74 () {60 vars in 1190 bytes} [Fri Nov 19 13:30:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 13:30:15.197023 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-acc5cc7b-aa17-4386-bbf2-51e7e01d9fa4 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:15.210679 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-acc5cc7b-aa17-4386-bbf2-51e7e01d9fa4 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017534 Nov 19 13:30:15.211249 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 22/45] 10.222.0.74 () {60 vars in 1210 bytes} [Fri Nov 19 13:30:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:15.221733 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f3d292d2-eb27-49b6-8e3f-de4acba61835 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:15.236142 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f3d292d2-eb27-49b6-8e3f-de4acba61835 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018150 Nov 19 13:30:15.236679 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 24/46] 10.222.0.74 () {60 vars in 1210 bytes} [Fri Nov 19 13:30:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:15.247383 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-94bfed33-c19f-4944-bb83-d50fde3eeeae admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:15.252978 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.wsgi [None req-94bfed33-c19f-4944-bb83-d50fde3eeeae admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 13:30:15.253743 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-94bfed33-c19f-4944-bb83-d50fde3eeeae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:30:15.254715 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-94bfed33-c19f-4944-bb83-d50fde3eeeae admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011366 Nov 19 13:30:15.255260 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 23/47] 10.222.0.74 () {60 vars in 1190 bytes} [Fri Nov 19 13:30:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 13:30:16.671460 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f3d292d2-eb27-49b6-8e3f-de4acba61835 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:16.672720 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f3d292d2-eb27-49b6-8e3f-de4acba61835 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Nov 19 13:30:16.673308 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 25/48] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:16.877633 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-172bc7a1-8090-413c-986f-542c82b1dee0 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:16.883455 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.wsgi [None req-172bc7a1-8090-413c-986f-542c82b1dee0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 13:30:16.884037 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-172bc7a1-8090-413c-986f-542c82b1dee0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:30:16.884853 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-172bc7a1-8090-413c-986f-542c82b1dee0 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071120 Nov 19 13:30:16.885362 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 24/49] 10.222.0.74 () {60 vars in 1193 bytes} [Fri Nov 19 13:30:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 13:30:16.895804 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-b0c4bd12-d352-40e7-8ab1-4bf8efb169e0 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:16.916250 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-b0c4bd12-d352-40e7-8ab1-4bf8efb169e0 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023924 Nov 19 13:30:16.917010 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 26/50] 10.222.0.74 () {60 vars in 1210 bytes} [Fri Nov 19 13:30:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:16.933299 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:16.956300 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029148 Nov 19 13:30:16.956966 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 25/51] 10.222.0.74 () {60 vars in 1210 bytes} [Fri Nov 19 13:30:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:30:16.967470 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-cc2aba86-7eff-4926-9506-39fd39350467 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:16.973523 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.wsgi [None req-cc2aba86-7eff-4926-9506-39fd39350467 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 13:30:16.974087 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-cc2aba86-7eff-4926-9506-39fd39350467 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:30:16.974873 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-cc2aba86-7eff-4926-9506-39fd39350467 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011097 Nov 19 13:30:16.975419 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 27/52] 10.222.0.74 () {60 vars in 1193 bytes} [Fri Nov 19 13:30:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 19 13:30:18.392870 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:18.394474 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002288 Nov 19 13:30:18.395153 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:18 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:18.601424 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-5b27e6c7-fab7-4880-9708-4d3959beaadc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:30:18.624147 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-5b27e6c7-fab7-4880-9708-4d3959beaadc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090435 Nov 19 13:30:18.624682 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 28/54] 10.222.0.74 () {64 vars in 1235 bytes} [Fri Nov 19 13:30:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:30:20.026603 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:20.027663 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Nov 19 13:30:20.028081 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:20.229634 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-ee1483b8-895d-48c0-a4e6-b15284ce471b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:30:20.250077 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-ee1483b8-895d-48c0-a4e6-b15284ce471b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.083108 Nov 19 13:30:20.250643 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 29/56] 10.222.0.74 () {64 vars in 1235 bytes} [Fri Nov 19 13:30:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:30:21.665085 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:21.666870 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002724 Nov 19 13:30:21.667791 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 28/57] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:21 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:21.884558 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-4f11a3d4-9b06-4cf5-83f2-9acf55154b20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:30:21.905786 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-4f11a3d4-9b06-4cf5-83f2-9acf55154b20 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083593 Nov 19 13:30:21.906364 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 30/58] 10.222.0.74 () {64 vars in 1235 bytes} [Fri Nov 19 13:30:21 2021] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:30:23.328877 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:23.329881 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 19 13:30:23.330272 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 29/59] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:23.531456 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-ee90de8b-7984-42e3-b1c6-3419f8f0cd3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:30:23.553535 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-ee90de8b-7984-42e3-b1c6-3419f8f0cd3b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081751 Nov 19 13:30:23.554090 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 31/60] 10.222.0.74 () {64 vars in 1235 bytes} [Fri Nov 19 13:30:23 2021] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:30:25.013917 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:25.015065 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Nov 19 13:30:25.015560 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 30/61] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:30:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:30:25.212641 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-0a94b01a-92b8-4ded-b810-8a0ab322eb6a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:30:25.232190 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-0a94b01a-92b8-4ded-b810-8a0ab322eb6a admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074712 Nov 19 13:30:25.232736 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 32/62] 10.222.0.74 () {60 vars in 1202 bytes} [Fri Nov 19 13:30:25 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:31:12.630177 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:31:12.631337 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b21c0ed1-a701-45b8-a96a-0d6c231abeb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Nov 19 13:31:12.631828 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 930 bytes} [Fri Nov 19 13:31:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:31:12.699440 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-7befb956-5419-46f6-9a81-de89823b71cd admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:31:12.728224 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-7befb956-5419-46f6-9a81-de89823b71cd admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.089626 Nov 19 13:31:12.728736 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 33/64] 10.222.0.74 () {60 vars in 1291 bytes} [Fri Nov 19 13:31:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:31:12.751501 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-a05ed566-eeb3-4b8c-996c-5641aca9ccd8 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:31:12.759503 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-a05ed566-eeb3-4b8c-996c-5641aca9ccd8 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011634 Nov 19 13:31:12.760033 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 32/65] 10.222.0.74 () {60 vars in 1282 bytes} [Fri Nov 19 13:31:12 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:31:12.773224 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-045c8bf2-c681-41dd-a959-7c038548bd07 admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:31:12.781283 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-045c8bf2-c681-41dd-a959-7c038548bd07 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012266 Nov 19 13:31:12.781804 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 34/66] 10.222.0.74 () {60 vars in 1285 bytes} [Fri Nov 19 13:31:12 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:31:12.793547 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-d74537aa-5c35-4342-b353-bd7711696edb admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:31:12.801272 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-d74537aa-5c35-4342-b353-bd7711696edb admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011287 Nov 19 13:31:12.801797 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 33/67] 10.222.0.74 () {60 vars in 1285 bytes} [Fri Nov 19 13:31:12 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:31:12.814626 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:31:12.824859 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014403 Nov 19 13:31:12.825558 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 35/68] 10.222.0.74 () {60 vars in 1282 bytes} [Fri Nov 19 13:31:12 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:32:36.793431 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-01918abf-ed05-4fa8-96a9-491323acc4a0 tempest-verify_tempest_config-1404755649 tempest-verify_tempest_config-1404755649-project] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:32:36.795495 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-01918abf-ed05-4fa8-96a9-491323acc4a0 tempest-verify_tempest_config-1404755649 tempest-verify_tempest_config-1404755649-project] 10.222.0.74 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.114786 Nov 19 13:32:36.796037 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 34/69] 10.222.0.74 () {58 vars in 1133 bytes} [Fri Nov 19 13:32:36 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:34:09.124223 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:09.125249 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Nov 19 13:34:09.125699 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 36/70] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:34:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:34:09.397939 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-39df5638-e31e-430e-8ef8-c684b621689c admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:09.399130 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:34:09.399130 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: warnings.warn(msg) Nov 19 13:34:09.400690 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-39df5638-e31e-430e-8ef8-c684b621689c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:09.401140 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-39df5638-e31e-430e-8ef8-c684b621689c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:09.401995 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-39df5638-e31e-430e-8ef8-c684b621689c admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:09.402423 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-39df5638-e31e-430e-8ef8-c684b621689c admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:09.436606 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-39df5638-e31e-430e-8ef8-c684b621689c admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.169354 Nov 19 13:34:09.437140 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 35/71] 10.222.0.74 () {60 vars in 1193 bytes} [Fri Nov 19 13:34:09 2021] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:34:10.869607 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:10.870860 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Nov 19 13:34:10.871498 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 37/72] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:34:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:34:11.073660 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-7edcceb5-2f70-4ff7-b347-9100eb9fa7d2 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:11.074946 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:34:11.074946 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: warnings.warn(msg) Nov 19 13:34:11.076489 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-7edcceb5-2f70-4ff7-b347-9100eb9fa7d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:11.076928 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-7edcceb5-2f70-4ff7-b347-9100eb9fa7d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:11.077725 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-7edcceb5-2f70-4ff7-b347-9100eb9fa7d2 admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:11.078145 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-7edcceb5-2f70-4ff7-b347-9100eb9fa7d2 admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:11.102662 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-7edcceb5-2f70-4ff7-b347-9100eb9fa7d2 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091550 Nov 19 13:34:11.103262 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 36/73] 10.222.0.74 () {60 vars in 1193 bytes} [Fri Nov 19 13:34:11 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:34:22.983957 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:22.985153 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Nov 19 13:34:22.985547 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 38/74] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:34:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:34:23.192222 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-b2a731bf-608b-4e65-b513-62b368bd8b2b admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:23.193589 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:34:23.193589 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: warnings.warn(msg) Nov 19 13:34:23.195774 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2a731bf-608b-4e65-b513-62b368bd8b2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:23.196430 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2a731bf-608b-4e65-b513-62b368bd8b2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:23.197620 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2a731bf-608b-4e65-b513-62b368bd8b2b admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:23.198277 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-b2a731bf-608b-4e65-b513-62b368bd8b2b admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:23.224954 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-b2a731bf-608b-4e65-b513-62b368bd8b2b admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094121 Nov 19 13:34:23.225620 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 37/75] 10.222.0.74 () {60 vars in 1193 bytes} [Fri Nov 19 13:34:23 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:34:24.661320 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: DEBUG nova.api.openstack.wsgi [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] Calling method '>' {{(pid=102128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:24.662327 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: INFO nova.api.openstack.requestlog [None req-f950b228-27bf-4e7e-b776-b56099886a6a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Nov 19 13:34:24.662840 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: [pid: 102128|app: 0|req: 39/76] 10.222.0.74 () {56 vars in 1074 bytes} [Fri Nov 19 13:34:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:34:24.858578 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG nova.api.openstack.wsgi [None req-f4a21f7d-b048-4284-a101-c0326c74fc74 admin admin] Calling method '>' {{(pid=102129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:34:24.859776 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:34:24.859776 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: warnings.warn(msg) Nov 19 13:34:24.861317 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-f4a21f7d-b048-4284-a101-c0326c74fc74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:24.861756 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-f4a21f7d-b048-4284-a101-c0326c74fc74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:24.862552 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-f4a21f7d-b048-4284-a101-c0326c74fc74 admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:34:24.863009 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: DEBUG oslo_concurrency.lockutils [None req-f4a21f7d-b048-4284-a101-c0326c74fc74 admin admin] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:34:24.885155 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: INFO nova.api.openstack.requestlog [None req-f4a21f7d-b048-4284-a101-c0326c74fc74 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083554 Nov 19 13:34:24.885641 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: [pid: 102129|app: 0|req: 38/77] 10.222.0.74 () {60 vars in 1193 bytes} [Fri Nov 19 13:34:24 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:35:21.164567 dv-cinder-817351-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 19 13:35:21.165383 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: Fri Nov 19 13:35:21 2021 - graceful shutdown triggered... Nov 19 13:35:21.165864 dv-cinder-817351-4-iscsi devstack@n-api.service[102128]: Gracefully killing worker 1 (pid: 102128)... Nov 19 13:35:21.166863 dv-cinder-817351-4-iscsi devstack@n-api.service[102129]: Gracefully killing worker 2 (pid: 102129)... Nov 19 13:35:22.166233 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: worker 1 buried after 1 seconds Nov 19 13:35:22.166233 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: worker 2 buried after 1 seconds Nov 19 13:35:22.166233 dv-cinder-817351-4-iscsi devstack@n-api.service[102127]: goodbye to uWSGI. Nov 19 13:35:22.167840 dv-cinder-817351-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 19 13:35:22.168448 dv-cinder-817351-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 19 13:35:22.171421 dv-cinder-817351-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 13:35:22.182981 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 13:35:22 2021] *** Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: nodename: dv-cinder-817351-4-iscsi Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: machine: x86_64 Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: clock source: unix Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: pcre jit disabled Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: detected number of CPU cores: 4 Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: current working directory: / Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: detected binary path: /usr/bin/uwsgi-core Nov 19 13:35:22.185032 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: your processes number limit is 47680 Nov 19 13:35:22.185807 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: your memory page size is 4096 bytes Nov 19 13:35:22.185807 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: detected max file descriptor number: 2048 Nov 19 13:35:22.185807 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: lock engine: pthread robust mutexes Nov 19 13:35:22.185807 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: thunder lock: enabled Nov 19 13:35:22.185807 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 13:35:22.185807 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 13:35:22.232769 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: Python main interpreter initialized at 0x56022b6ba9c0 Nov 19 13:35:22.232769 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: python threads support enabled Nov 19 13:35:22.232769 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: your server socket listen backlog is limited to 100 connections Nov 19 13:35:22.232769 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: your mercy for graceful operations on workers is 90 seconds Nov 19 13:35:22.233216 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 13:35:22.233216 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: *** Operational MODE: preforking *** Nov 19 13:35:22.233565 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: *** uWSGI is running in multiple interpreter mode *** Nov 19 13:35:22.233565 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: spawned uWSGI master process (pid: 122796) Nov 19 13:35:22.233743 dv-cinder-817351-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 13:35:22.234990 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: spawned uWSGI worker 1 (pid: 122814, cores: 1) Nov 19 13:35:22.234990 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: spawned uWSGI worker 2 (pid: 122815, cores: 1) Nov 19 13:35:22.234990 dv-cinder-817351-4-iscsi devstack@n-api.service[122796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 13:35:24.015674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:35:24.015674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: from cryptography.utils import int_from_bytes Nov 19 13:35:24.016467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:35:24.016467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: from cryptography.utils import int_from_bytes Nov 19 13:35:24.052858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:35:24.052858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: from cryptography.utils import int_from_bytes Nov 19 13:35:24.053649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 13:35:24.053649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: from cryptography.utils import int_from_bytes Nov 19 13:35:26.468888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 13:35:26.469557 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 13:35:26.469652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 13:35:26.470010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 13:35:26.470268 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 13:35:26.470659 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.470985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.471340 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.471672 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.472157 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.473621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.473621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.473621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.473845 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 13:35:26.474353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.474434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 13:35:26.474513 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.474593 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 13:35:26.474685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.474685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817351-4-iscsi {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.474826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 13:35:26.474826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 13:35:26.474960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.474960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.476141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.476357 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.476575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.476729 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.476876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.476876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.477279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.477486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.477766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.478012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.478245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.478507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.478507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.478971 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.479301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.479301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.479301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.479301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817351-4-iscsi {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.479301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.479301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.480663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.480903 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481422 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481563 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481741 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.481888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.482233 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.482385 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.482525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.482672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.482672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.482953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.483124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.483124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.484686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.484835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.485925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486075 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817351-4-iscsi {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486215 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817351-4-iscsi {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486361 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486508 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486657 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486805 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.486963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.487136 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.487281 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.487451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.487674 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.487905 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.488158 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.488330 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.488480 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.488638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.488790 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.488930 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489226 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489520 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.489952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.490098 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.490323 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.490470 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.490616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.491926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.492091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.492255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.492414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.492627 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.492821 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.492973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.493123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.493272 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.493443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.493443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.493443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.494874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.494874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.495251 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.495469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.495694 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.495850 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.495999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.496151 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.496306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.496450 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.496605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.496746 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.496891 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497488 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497790 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.497937 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498083 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498221 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498503 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498798 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.498952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.499147 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.499294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.499444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.499621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.499776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.499916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500205 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500342 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500781 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.500941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501090 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501237 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501237 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501789 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.501928 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502074 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502214 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502353 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.502964 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.503810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.503908 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.503984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504470 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.504968 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505197 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505398 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505570 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505859 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.505926 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506375 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506457 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.506962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507309 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507387 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.507956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.508150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.508330 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.508480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.508810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.509127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.509251 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.509439 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.509754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.510070 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.510279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.510401 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.510620 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.510726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.510950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.511055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.511309 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.511417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.511627 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.511788 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.511931 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.512079 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.512252 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.512398 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.512560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.512713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.512855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.513003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.513409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.513582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.513726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.513874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.514088 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.514320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.514477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.514691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.514841 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515175 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515336 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515825 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.515974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.516123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.516271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.516427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.516569 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.516711 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.516851 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517155 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517304 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517446 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517630 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517784 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.517979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.518203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.518442 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.518664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.518906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.519205 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.520559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.520765 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.520928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.521083 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.521229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.521377 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.521377 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.521662 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.521813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 13:35:26.521963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.522113 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.522435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.522671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.522843 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.522991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.523162 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.523310 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.523464 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.523614 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.523771 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.523914 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.524060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.524214 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.524363 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.524524 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.524687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.524687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.525181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.525331 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.525473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.525628 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.525628 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.525904 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.526052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.526238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.526380 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.526574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.526753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.526917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.527073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.527260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.527411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.527554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.527707 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.527850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528006 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528291 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528431 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528728 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.528879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.529028 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.529168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.529322 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.529470 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.529944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.530732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.530895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.531047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.531230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.531374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.531514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.531666 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.531807 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.532170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.532367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.532620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.532771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.532912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533363 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533655 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533655 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533946 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.533946 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.534224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.534224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.534495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.534649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.534801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.534955 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.535138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.535298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.535447 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.535447 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.535808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.536043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.536273 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.536504 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.536758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.537002 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.537235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.537476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.537722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.537992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.538143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.538286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.538443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.538586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.538740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.538893 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.539035 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.539232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.539394 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.539537 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.539685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.540275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.540442 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.541099 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.541260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.541414 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.541579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.541721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.541863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542209 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542360 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542657 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.542952 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.543137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.543137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.543430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.543430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.543874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544468 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544620 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544773 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.544930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545078 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545367 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545677 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545831 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.545972 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546826 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546972 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.546972 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.547276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.547426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.547578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.547719 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.547860 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.547999 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.548156 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.548444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.548600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.548752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.548903 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.549053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.549195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.549417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.549570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.549718 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.549879 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.550306 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.550490 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.550653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.551269 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.551421 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.551562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.551562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.551844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.551986 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.552134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.552299 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.552441 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.552588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.552738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.552880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.553021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.553170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.553320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.553620 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.553820 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.554074 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.554221 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.554375 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.554538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.554742 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.554938 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.555083 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.555283 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.555652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.555814 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.555970 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.556184 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.556359 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.556501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.556650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.556822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.556999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.557141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.557282 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.557422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.557561 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.557710 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.557934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.558079 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.558226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.558375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.558642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.558796 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.558957 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559280 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559585 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559786 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.559944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.560524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.560524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.560824 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.562148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.562301 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.562467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.562612 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.562767 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.562917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.563067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.563237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.563534 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.563692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.563845 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.563988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.564573 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.564573 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.564869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.564869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.565148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.565297 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.565438 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.565587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.565736 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.565886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566460 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566613 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566779 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.566930 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.567078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.567283 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.567432 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.567579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.567730 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.567871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.568011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.568159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.568299 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.568454 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.568622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.568894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.569048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.569253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.569409 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.569560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.569765 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.569982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.570136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.570733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.570886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.571044 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.571245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.571887 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.572054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.572206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.572206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.572497 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.572647 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.572788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573174 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.573916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.574070 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.574220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.574370 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.574511 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.574772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.574920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575072 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575399 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.575985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.576139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.576289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.576429 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.576569 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.576716 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.576865 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577710 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.577862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578102 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578412 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578707 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.578874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.579280 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.579439 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.579584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.579737 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.579879 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.580038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.580188 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.580333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.580473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.580949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.581113 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.581275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.581420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.581593 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.582132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.582282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.582425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.582567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.582727 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.582884 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.583041 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.583260 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.583413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.583559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.583717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.583860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.584084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.584228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.584371 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.584518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.584670 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.585294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.585458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.585603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.585751 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.585751 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586185 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586484 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.586920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587085 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587085 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587359 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587454 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587747 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.587943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588027 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588111 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588450 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588545 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588637 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.588963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589158 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589333 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589423 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589662 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589856 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.589950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590033 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590117 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590399 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590565 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590818 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.590963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591141 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591313 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591410 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591509 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591695 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.591870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592744 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.592913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593079 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593356 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593700 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.593990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594257 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594428 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594605 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.594953 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595043 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595747 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.595930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596100 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596195 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596287 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596371 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596465 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596549 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596820 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.596994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597086 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.597960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598037 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598108 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598340 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598410 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598549 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598631 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598782 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598852 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.598997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599075 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599184 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599410 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599567 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599788 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.599942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600021 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600092 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600782 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.600990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.601069 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.601147 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.601970 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602091 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602319 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602388 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602388 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.602948 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603517 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603594 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603672 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603743 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603812 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.603882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.605251 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.605434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.605691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.605855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606332 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606484 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.606953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.607151 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.607323 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.607482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.607641 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.607800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.607951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608109 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608585 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608838 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.608935 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609114 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609195 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609453 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609568 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609812 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.609999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610358 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610677 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610800 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.610984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.611315 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.611426 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.611623 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.611716 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.611913 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.612081 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.612181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.612256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.612510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.612640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.612869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.613194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.613334 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.613534 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.613638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.613863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615340 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615764 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.615908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616097 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616994 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.616994 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617133 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617393 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617548 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617862 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.617957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.618196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.618402 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.618562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.618705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.618854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619288 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619488 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.619825 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.620034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.620127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.620343 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.620433 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.621536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.621631 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.621730 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.621811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.621882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.621951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622103 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622175 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622436 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622806 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622890 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.622961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.623038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.623298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.623393 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.623676 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.623771 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.623991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.624076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.624306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.624402 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.624800 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.624895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.624968 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625046 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625219 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625625 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.625951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.626160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.626260 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.626473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.626577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.626784 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.626890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.627159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.627266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.627448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.627528 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.627777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.627871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.628114 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.628217 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.628425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.628517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.628749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.628847 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629359 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629663 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.629985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.630179 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.630291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.630509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.630606 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.630840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.631012 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.631177 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.631363 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.631501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.631721 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.631874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.632239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.632330 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.632541 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633140 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633303 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633566 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.633927 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634129 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634214 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634409 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634503 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634733 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.634856 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.635307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.635433 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.635530 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.635650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.635795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.635937 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636297 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636453 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.636916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.637077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.637226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.637363 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.637618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.637732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.637979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.638075 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.638533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.638645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.638738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639148 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639385 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639673 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.639937 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640028 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640841 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.640952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.641154 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.641329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.641521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.641611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.641781 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.641879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.642080 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.642176 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.642396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.642491 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.642713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.642815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.643147 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.643260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.643460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.643560 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.643744 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.643834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.644013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.644113 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.644336 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.644432 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.644649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.644744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645174 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645372 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645463 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645636 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.645947 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646272 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646589 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646684 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.646992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.647316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.647485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.647790 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.647921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.648016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.648262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.648609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.648759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.648877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.649084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.649233 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.649406 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.649632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.649886 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.649972 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650058 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650896 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.650997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.651243 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.651340 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.651566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.651661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.651896 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.651985 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.652203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.652303 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.652512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.652603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.652820 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.652924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.653132 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.653225 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.653532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.653652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.653751 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.653847 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654464 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654669 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654768 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.654975 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.655085 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.655352 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.655441 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.655780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.655887 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.655982 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656565 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.656990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.657184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.657296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.657525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.657618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.657832 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.657937 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.658457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.658585 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.658673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.658745 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.658822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.658893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.659222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.659348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.659525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.659726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.659858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.660064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.660165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.660393 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.660517 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.660705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.660801 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.661029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.661146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.661355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.661475 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.661679 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.661771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.662004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.662107 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.662315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.662406 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.662630 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.662720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.663125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.663832 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.663988 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.664310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.664831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.664924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.665169 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.665267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.665969 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.666167 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.666491 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.666744 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.666869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.667231 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.667427 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.667521 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.667760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.667851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.668091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.668189 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.668488 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.668636 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.668811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.669394 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.669938 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.670038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.670305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.670518 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.670653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.670999 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.671124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.671387 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.671619 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.671923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.672235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.672517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.672815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.673090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.673406 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.673651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.673990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.674223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.674596 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.674810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.675303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.675486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.675993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.676134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.676942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.677318 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.677584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.678305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.678433 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.678560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.678743 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.679294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.679685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.679922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.680264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.680354 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.680713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.681598 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.681716 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.681716 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.681883 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.681956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.682149 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.682962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.683084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.683258 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.683343 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.683491 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.687803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.688823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.688965 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.689433 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.689567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.689567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.689738 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.689836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.689946 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690042 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690492 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690669 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690755 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.690849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691395 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691479 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691863 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.691947 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692317 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.692950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.693224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.693432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.693432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.693776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.693960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.693960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694782 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.694879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695129 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695559 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.695799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.696264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.696383 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.696481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.696726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.697039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.697161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.697336 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.697638 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.698911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.698911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.699269 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.699442 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.699616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.699782 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.700151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.700324 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.700494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.700649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.700649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.701523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.701602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.701673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.701742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.701834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.701934 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702026 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702298 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702389 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702659 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.702909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703349 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703522 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703636 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.703961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.704071 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.704286 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.704395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.704598 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.704692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.704913 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705863 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.705957 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.706171 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.706266 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.706485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.706581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.706802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.706936 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.707267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.707435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.707521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.707602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.707762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.707878 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708153 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708263 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.708987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.709080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.709316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.709431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.709629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.709772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.709996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.710224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.710383 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.710602 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.710745 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.710920 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.711054 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.711274 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.711409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.711593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.711739 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.711907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.712040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.712263 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.712395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.712583 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.712725 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.713066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.713197 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.713388 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.713713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.713840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.714128 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.714248 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.714451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.714573 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.714784 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.714937 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.715213 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.715353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.715480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.715607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.715773 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.715919 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.716089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.716222 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.716404 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.716535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.716718 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.716875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.717121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.717362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.717493 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.717639 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.717880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718306 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718417 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718679 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.718943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719079 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.719923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.720105 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.720238 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.720423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.720596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.720776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.720910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.721044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.721166 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.721355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.721475 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.721686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.721828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.722033 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.722175 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.722403 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.722538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.722720 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.722839 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.723039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.723217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.723377 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.723507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.723693 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.723832 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.724015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.724143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.724332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.724472 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.724667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.724807 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.725002 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.725145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.725316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.725536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.725778 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.725910 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.726106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.726433 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.726560 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.726872 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.727000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.727264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.727416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.727648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.727772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.727982 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728303 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728853 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.728975 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.729163 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.729290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.729473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.729601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.729878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730833 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.730974 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.731139 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.731413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.731741 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.732124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.732253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.732394 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.732599 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.732721 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.732973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.733094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.733455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.733612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.733742 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.733875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.734012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.734206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.734347 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.734476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.734611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 13:35:26.734745 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.734943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.736199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.736199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.736199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.736199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.736737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.736868 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.737152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.737475 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.737793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.738106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.738436 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.738750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.739077 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.739417 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.739760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.740078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.740396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.740731 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.741162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.741528 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.742110 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.742453 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.742778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.743256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.743503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.743802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.747289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.747289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 13:35:26.747289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 13:35:26.762811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:26.773030 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_db.sqlalchemy.engines [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:26.941592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.context [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa90e9eb-4700-48fd-b538-a6e9cc05f3ea(cell1) {{(pid=122814) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 13:35:26.947344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.context [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa90e9eb-4700-48fd-b538-a6e9cc05f3ea(cell1) {{(pid=122815) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 13:35:26.947920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:35:26.949801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:35:26.950852 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:35:26.951960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:35:26.953436 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:35:26.953593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:35:26.954495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:35:26.956750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:35:26.967224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:26.968512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_db.sqlalchemy.engines [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:26.969790 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:26.979484 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_db.sqlalchemy.engines [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:27.137841 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_db.sqlalchemy.engines [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:27.149492 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_db.sqlalchemy.engines [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 13:35:27.467424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:35:27.473978 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:35:27.481603 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: WARNING keystonemiddleware.auth_token [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:35:27.488415 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: WARNING keystonemiddleware.auth_token [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:35:27.827217 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:35:27.832730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: WARNING keystonemiddleware.auth_token [None req-7705b39e-8962-4ab3-b964-e1f1fbce0f87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:35:27.838907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56022b6ba9c0 pid: 122814 (default app) Nov 19 13:35:27.848014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: WARNING keystonemiddleware.auth_token [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 13:35:27.854123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: WARNING keystonemiddleware.auth_token [None req-3587fcad-8e14-49ab-9b85-2ad986312560 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 13:35:27.859595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56022b6ba9c0 pid: 122815 (default app) Nov 19 13:36:02.798621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-79dc15e8-7efd-4c8f-b2ce-a79ef32fd800 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Action: 'create', calling method: .version_select at 0x7fb42bc325e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-17854782"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:03.020117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9b66e4c0-ec71-4459-b825-79e92c4b823d tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Action: 'create', calling method: .version_select at 0x7fb42bc335e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-231243253", "metadata": {"Type": "work"}}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:04.236857 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-79dc15e8-7efd-4c8f-b2ce-a79ef32fd800 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 2.339796 Nov 19 13:36:04.238355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 1/1] 10.222.0.74 () {60 vars in 1154 bytes} [Fri Nov 19 13:36:01 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 2343 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 13:36:04.464619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9b66e4c0-ec71-4459-b825-79e92c4b823d tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.798939 Nov 19 13:36:04.465273 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 1/2] 10.222.0.74 () {60 vars in 1155 bytes} [Fri Nov 19 13:36:01 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2801 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 13:36:04.472049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-207b36c5-f1cd-424e-9073-e3eec81a3f69 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42bafb1f0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:04.500985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-195994875", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "9260939e-b253-4e9b-9ebc-5d336dec1f11"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:04.609637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-207b36c5-f1cd-424e-9073-e3eec81a3f69 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 200 len: 343 microversion: 2.1 time: 0.142900 Nov 19 13:36:04.610451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:04 2021] GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 343 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:04.617802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e017d0d5-d6ae-41f1-a867-6e1cc9357784 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42bafba60>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:04.661478 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] validate_networks() for [('9260939e-b253-4e9b-9ebc-5d336dec1f11', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:36:04.722170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e017d0d5-d6ae-41f1-a867-6e1cc9357784 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 200 len: 352 microversion: 2.1 time: 0.109874 Nov 19 13:36:04.722982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 3/4] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:04 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:05.588668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1696790066", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "d4b5f30c-9859-4dc0-9964-fe81b0775d18"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:05.702956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] validate_networks() for [('d4b5f30c-9859-4dc0-9964-fe81b0775d18', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:36:06.639605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:36:06.640173 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:36:06.640731 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:36:06.641003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:36:06.645071 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:36:06.663422 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:06.664475 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:06.665640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:06.666411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:06.782226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Getting quotas for project 24e3eb64abd04110a6520c0499e7ce7c. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:06.821851 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Getting quotas for user d9b51a1d61024e54be8bff35f39cf863 and project 24e3eb64abd04110a6520c0499e7ce7c. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:06.853026 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:36:06.857353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:36:06.999551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ed7d7204-5154-41ec-a9d4-f05442f035cd tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.758589 Nov 19 13:36:07.001335 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 2/5] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:36:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 2762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:36:07.014089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-edf2def0-b3f0-4fa1-95ea-66aae8a983b9 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42ba00940>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:07.101238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-edf2def0-b3f0-4fa1-95ea-66aae8a983b9 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 200 len: 344 microversion: 2.1 time: 0.098409 Nov 19 13:36:07.104063 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 3/6] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:07 2021] GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:07.109887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-79b70897-3f73-47b8-988f-90205ac2fd7a tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42ba265e0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:07.192534 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-79b70897-3f73-47b8-988f-90205ac2fd7a tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 200 len: 353 microversion: 2.1 time: 0.086700 Nov 19 13:36:07.193367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 4/7] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:07 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:07.201397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0b0af908-7a71-45b9-8137-593d49e568ba tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:07.201523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0b0af908-7a71-45b9-8137-593d49e568ba tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:07.401874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0b0af908-7a71-45b9-8137-593d49e568ba tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:07.441323 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0b0af908-7a71-45b9-8137-593d49e568ba tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1214 microversion: 2.1 time: 0.246649 Nov 19 13:36:07.451164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 5/8] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:07 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:07.455766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a5c335ec-f35e-4912-8ac4-ae4421278bb1 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Action: 'create', calling method: .version_select at 0x7fb42a9bd550>, body: {"snapshot": {"volume_id": "e85ec966-bfdc-44b2-b91f-a3c15661454c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1069231534"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:07.815763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a5c335ec-f35e-4912-8ac4-ae4421278bb1 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.368874 Nov 19 13:36:07.816642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 6/9] 10.222.0.74 () {60 vars in 1161 bytes} [Fri Nov 19 13:36:07 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:07.821612 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b4069bdb-bcce-4d0a-8c67-ebf5a0ed5ca7 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42c4d8af0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:07.937515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b4069bdb-bcce-4d0a-8c67-ebf5a0ed5ca7 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 200 len: 353 microversion: 2.1 time: 0.120046 Nov 19 13:36:07.938853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 7/10] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:07 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:07.943874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-976974ed-6cf2-4c41-9d0f-06fc832ef199 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a9ce3a0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:07.988032 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-976974ed-6cf2-4c41-9d0f-06fc832ef199 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 200 len: 287 microversion: 2.1 time: 0.047925 Nov 19 13:36:07.989277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 8/11] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:07 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:07.994171 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9ba9cd72-98b1-4230-b025-8aa5943a1461 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42a9ceee0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:08.105112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9ba9cd72-98b1-4230-b025-8aa5943a1461 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 202 len: 0 microversion: 2.1 time: 0.114238 Nov 19 13:36:08.107397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 9/12] 10.222.0.74 () {58 vars in 1247 bytes} [Fri Nov 19 13:36:07 2021] DELETE /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:36:08.113872 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f6bc997c-1837-4637-806f-ff5e59ac6657 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a9cedc0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:08.184255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f6bc997c-1837-4637-806f-ff5e59ac6657 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.074786 Nov 19 13:36:08.195216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 10/13] 10.222.0.74 () {58 vars in 1139 bytes} [Fri Nov 19 13:36:08 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:08.196309 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0f240691-0dab-4f28-b247-83135c78b6c5 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42c4d8c10>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:08.297684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0f240691-0dab-4f28-b247-83135c78b6c5 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 200 len: 352 microversion: 2.1 time: 0.106293 Nov 19 13:36:08.298550 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 11/14] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:08 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:08.307637 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b81b0034-9d1f-4216-9d76-83de54319172 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a9da5e0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:08.356988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b81b0034-9d1f-4216-9d76-83de54319172 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 200 len: 287 microversion: 2.1 time: 0.056777 Nov 19 13:36:08.358614 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 12/15] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:08 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:08.401902 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:36:08.403222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:36:08.404571 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:36:08.405264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:36:08.405878 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:36:08.430026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:08.431975 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:08.435473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:08.436592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:08.461038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2e4048ae-3cab-4132-88ba-be73e15ab744 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:08.461880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2e4048ae-3cab-4132-88ba-be73e15ab744 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:08.546777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:08.572266 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for user 94c7c0bfd6f84b29b28fec4fcef50f41 and project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:08.596695 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:36:08.611704 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:36:08.749968 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2e4048ae-3cab-4132-88ba-be73e15ab744 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:08.760471 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2e4048ae-3cab-4132-88ba-be73e15ab744 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1214 microversion: 2.1 time: 0.304118 Nov 19 13:36:08.783127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6980e21a-ccaa-4d60-a2f4-81a9345db962 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428542 Nov 19 13:36:08.784261 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 4/16] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:36:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 3430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 13:36:08.796119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 13/17] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:08 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1214 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:08.796611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e952020d-e2c0-462e-b2d5-ed47c943e271 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:08.798788 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e952020d-e2c0-462e-b2d5-ed47c943e271 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:08.988705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e952020d-e2c0-462e-b2d5-ed47c943e271 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:09.018996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e952020d-e2c0-462e-b2d5-ed47c943e271 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1218 microversion: 2.1 time: 0.226080 Nov 19 13:36:09.020231 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 5/18] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:08 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:09.322044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3982ee3e-b7be-41b4-9323-5c1b38d3f2f7 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42a9cef70>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:09.370409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-08fe8517-cb9b-4153-87f3-3db97fb12835 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a9b75e0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:09.422710 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-08fe8517-cb9b-4153-87f3-3db97fb12835 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 200 len: 287 microversion: 2.1 time: 0.056602 Nov 19 13:36:09.423600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 6/19] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:09 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:09.432142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3982ee3e-b7be-41b4-9323-5c1b38d3f2f7 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 200 len: 352 microversion: 2.1 time: 0.120162 Nov 19 13:36:09.433198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 14/20] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:09 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:09.785596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:09.787606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:09.809341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:09.810174 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:09.812255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:09.816299 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:10.038077 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-edba011f-fdad-470b-a898-bf8cee6c34ce tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:10.038950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-edba011f-fdad-470b-a898-bf8cee6c34ce tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:10.117277 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:10.140068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ff76923a-1a64-4ad2-88fd-1168bf7bdb58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1218 microversion: 2.1 time: 0.360655 Nov 19 13:36:10.141830 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 7/21] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:09 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1218 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:10.184079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-edba011f-fdad-470b-a898-bf8cee6c34ce tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:10.208089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-edba011f-fdad-470b-a898-bf8cee6c34ce tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1218 microversion: 2.1 time: 0.169122 Nov 19 13:36:10.209629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 15/22] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:10 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:10.434818 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4168c170-aa02-4908-8179-62a34803a4c2 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a937c10>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:10.447252 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c7e992de-9cd7-47e6-9f6b-f0d5d97679b4 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42a9cedc0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:10.595346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c7e992de-9cd7-47e6-9f6b-f0d5d97679b4 tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 200 len: 352 microversion: 2.1 time: 0.153038 Nov 19 13:36:10.595924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 16/23] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:10 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:36:10.637214 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4168c170-aa02-4908-8179-62a34803a4c2 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 200 len: 287 microversion: 2.1 time: 0.206786 Nov 19 13:36:10.638519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 8/24] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:10 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:11.158767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:11.159731 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:11.177270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:11.182882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:11.184667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:11.190108 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:11.227144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:11.227926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:11.261827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:11.265515 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:11.268495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:11.269096 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:11.496935 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:11.538031 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4fa50d9b-7a7e-4f64-98b7-d6000586f9d7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1222 microversion: 2.1 time: 0.311121 Nov 19 13:36:11.540144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 9/25] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:11 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1222 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:11.613381 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-08446860-b2bd-484d-8b37-9904e78310ca tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Calling method '.version_select at 0x7fb42a947940>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:11.667302 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-08446860-b2bd-484d-8b37-9904e78310ca tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] HTTP exception thrown: Volume 4569c26c-e8ca-4b59-92be-b23744bcd785 could not be found. Nov 19 13:36:11.668442 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-08446860-b2bd-484d-8b37-9904e78310ca tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] Returning 404 to user: Volume 4569c26c-e8ca-4b59-92be-b23744bcd785 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:36:11.669526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-08446860-b2bd-484d-8b37-9904e78310ca tempest-VolumesGetTestJSON-1473731256 tempest-VolumesGetTestJSON-1473731256-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785" status: 404 len: 109 microversion: 2.1 time: 0.063817 Nov 19 13:36:11.670274 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 10/26] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:11 2021] GET /compute/v2.1/os-volumes/4569c26c-e8ca-4b59-92be-b23744bcd785 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:36:11.677592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9cbba2b8-7ec8-4993-bd20-20fa98a03855 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42c4d8a60>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:11.746017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9cbba2b8-7ec8-4993-bd20-20fa98a03855 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 200 len: 288 microversion: 2.1 time: 0.074500 Nov 19 13:36:11.752945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 11/27] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:11 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:11.760296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-aa6f4b82-d2ff-4076-a514-5d185b47ce9b tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a9479d0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:11.902445 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:11.926310 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3de54bd6-634e-4926-bcd5-464c4b89e9da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1210 microversion: 2.1 time: 0.772206 Nov 19 13:36:11.929981 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 17/28] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:11 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1210 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:11.942349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-aa6f4b82-d2ff-4076-a514-5d185b47ce9b tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "DELETE /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 202 len: 0 microversion: 2.1 time: 0.186349 Nov 19 13:36:11.950567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 12/29] 10.222.0.74 () {58 vars in 1253 bytes} [Fri Nov 19 13:36:11 2021] DELETE /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:36:11.953363 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-89d5ed15-00e3-4dcb-b38c-b29a25e2507a tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a93ac10>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:12.032702 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-89d5ed15-00e3-4dcb-b38c-b29a25e2507a tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 200 len: 287 microversion: 2.1 time: 0.084049 Nov 19 13:36:12.033344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 18/30] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:11 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:12.559145 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:12.559827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:12.572606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:12.573424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:12.575580 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:12.576728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:13.088377 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:13.103282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-52e69620-c923-4b00-939f-51c46077258b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1270 microversion: 2.1 time: 0.550606 Nov 19 13:36:13.107500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 13/31] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:12 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1270 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:13.116832 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:13.123490 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:13.141452 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:13.141907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:13.142728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:13.143193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:13.370172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1368894142", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7d44de9-88f3-4c50-9fb4-20415f65d215"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:13.517351 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] validate_networks() for [('b7d44de9-88f3-4c50-9fb4-20415f65d215', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:36:14.112380 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:14.126329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2b74c213-e2c8-4b67-b8a4-e58c6dadd2f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1272 microversion: 2.1 time: 1.015174 Nov 19 13:36:14.129355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 14/32] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:13 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1272 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:14.146859 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0cdeac47-0e0a-43d0-a926-fdc572239a41 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a911c10>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:14.197280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-0cdeac47-0e0a-43d0-a926-fdc572239a41 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] HTTP exception thrown: Snapshot b48d5150-23c1-485f-b1e6-199fbda22479 could not be found. Nov 19 13:36:14.197985 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0cdeac47-0e0a-43d0-a926-fdc572239a41 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Returning 404 to user: Snapshot b48d5150-23c1-485f-b1e6-199fbda22479 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:36:14.199414 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0cdeac47-0e0a-43d0-a926-fdc572239a41 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479" status: 404 len: 111 microversion: 2.1 time: 0.068255 Nov 19 13:36:14.200189 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 15/33] 10.222.0.74 () {58 vars in 1250 bytes} [Fri Nov 19 13:36:14 2021] GET /compute/v2.1/os-snapshots/b48d5150-23c1-485f-b1e6-199fbda22479 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:36:14.217366 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:14.219563 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:14.258703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:14.259939 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:14.262767 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:14.263856 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:15.192151 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:15.206911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c5d91968-44eb-4a57-99b9-f08a2b1aadfd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1276 microversion: 2.1 time: 1.001521 Nov 19 13:36:15.207663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 16/34] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:14 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1276 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:15.220286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1fda0ee4-86fc-4ea6-9662-e695f478aa59 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a911f70>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:15.457261 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1fda0ee4-86fc-4ea6-9662-e695f478aa59 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 202 len: 0 microversion: 2.1 time: 0.248265 Nov 19 13:36:15.458182 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 17/35] 10.222.0.74 () {58 vars in 1247 bytes} [Fri Nov 19 13:36:15 2021] DELETE /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:36:15.465337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:15.466508 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:15.483278 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:15.487406 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:15.490275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:15.491142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:16.994024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:17.008115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5a73519e-4e83-449c-8017-1f306725e92b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 1.547465 Nov 19 13:36:17.009959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 18/36] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:15 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:17.018176 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e27ad522-d255-4792-bd05-66a4e1d22a90 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a951a60>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:17.164075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e27ad522-d255-4792-bd05-66a4e1d22a90 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 200 len: 343 microversion: 2.1 time: 0.152673 Nov 19 13:36:17.165099 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 19/37] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:17 2021] GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 343 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:17.175984 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:17.178800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:17.210105 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:17.210581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:17.222053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:17.222633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:17.509421 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:17.520583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-241906d8-04f8-4b0a-be12-e888186d2c5d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1276 microversion: 2.1 time: 0.347900 Nov 19 13:36:17.528562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 20/38] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:17 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1276 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:18.031475 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:18.037553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:18.062012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:18.062595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:18.063852 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:18.064361 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:18.622221 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:36:18.622737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:36:18.623253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:36:18.623676 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:36:18.624092 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:36:18.651305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:18.651769 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:18.652600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:18.653045 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:18.728855 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Getting quotas for project dfe06ab44f6d441fbd48e98b2ba2119b. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:18.735750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Getting quotas for user ec0e8eed657b4628a26887809588106e and project dfe06ab44f6d441fbd48e98b2ba2119b. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:18.784378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:36:18.792580 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:36:18.898466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-381c248d-8143-483f-99d2-d0a7a7eca495 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.966547 Nov 19 13:36:18.903796 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:36:12 2021] POST /compute/v2.1/servers => generated 383 bytes in 5976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 13:36:18.912028 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2382ca08-b810-4d4e-a218-f751fe91a1fe tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a93ae50>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:19.044915 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-2382ca08-b810-4d4e-a218-f751fe91a1fe tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] HTTP exception thrown: Volume e85ec966-bfdc-44b2-b91f-a3c15661454c could not be found. Nov 19 13:36:19.045834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2382ca08-b810-4d4e-a218-f751fe91a1fe tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Returning 404 to user: Volume e85ec966-bfdc-44b2-b91f-a3c15661454c could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:36:19.047290 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2382ca08-b810-4d4e-a218-f751fe91a1fe tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 404 len: 109 microversion: 2.1 time: 0.142087 Nov 19 13:36:19.060783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 20/40] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:18 2021] GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:36:19.080674 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:19.084200 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:19.108310 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:19.121709 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:19.125170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:19.125859 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:19.372269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:19.405815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ca24546b-81c5-44ae-9b60-a6dbea2a6022 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 1.381320 Nov 19 13:36:19.408244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 21/41] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:18 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:19.439153 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7dd55d39-1584-4a89-9d18-006a1a435441 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:19.440980 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7dd55d39-1584-4a89-9d18-006a1a435441 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:19.583893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:19.592559 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d86f4fff-c892-4f4c-affe-cf29a645c58c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1276 microversion: 2.1 time: 0.529237 Nov 19 13:36:19.603586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 21/42] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:19 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1276 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:19.609536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1c5d8df1-34d4-4445-b091-a36f137cf560 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a8faee0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:19.670119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-1c5d8df1-34d4-4445-b091-a36f137cf560 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] HTTP exception thrown: Volume e85ec966-bfdc-44b2-b91f-a3c15661454c could not be found. Nov 19 13:36:19.670723 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1c5d8df1-34d4-4445-b091-a36f137cf560 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Returning 404 to user: Volume e85ec966-bfdc-44b2-b91f-a3c15661454c could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:36:19.671710 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1c5d8df1-34d4-4445-b091-a36f137cf560 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 404 len: 109 microversion: 2.1 time: 0.067020 Nov 19 13:36:19.672254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 22/43] 10.222.0.74 () {58 vars in 1247 bytes} [Fri Nov 19 13:36:19 2021] DELETE /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:36:19.681231 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-48dde7c4-216b-4a2b-90ce-a81e37688300 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Calling method '.version_select at 0x7fb42a91dd30>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:19.769346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-48dde7c4-216b-4a2b-90ce-a81e37688300 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] HTTP exception thrown: Volume e85ec966-bfdc-44b2-b91f-a3c15661454c could not be found. Nov 19 13:36:19.770901 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-48dde7c4-216b-4a2b-90ce-a81e37688300 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] Returning 404 to user: Volume e85ec966-bfdc-44b2-b91f-a3c15661454c could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:36:19.776468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-48dde7c4-216b-4a2b-90ce-a81e37688300 tempest-VolumesSnapshotsTestJSON-1195917399 tempest-VolumesSnapshotsTestJSON-1195917399-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c" status: 404 len: 109 microversion: 2.1 time: 0.099748 Nov 19 13:36:19.777633 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 23/44] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:36:19 2021] GET /compute/v2.1/os-volumes/e85ec966-bfdc-44b2-b91f-a3c15661454c => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:36:19.796003 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7dd55d39-1584-4a89-9d18-006a1a435441 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:19.805200 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7dd55d39-1584-4a89-9d18-006a1a435441 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1222 microversion: 2.1 time: 0.393632 Nov 19 13:36:19.807142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 22/45] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:19 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1222 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:20.425888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:20.428072 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:20.450544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:20.451087 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:20.469624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:20.470083 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:20.781152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3ebaff4f-ddee-4eb0-951d-36b43f2d2083 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'create', calling method: .version_select at 0x7fb42c4d8a60>, body: {"keypair": {"name": "tempest-keypair-2038749566"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:20.841582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-3ebaff4f-ddee-4eb0-951d-36b43f2d2083 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:20.852808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-3ebaff4f-ddee-4eb0-951d-36b43f2d2083 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for user 4e712519a9d54cee964e57814985b4ab and project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:21.167924 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:21.176663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a6e04b1a-13d1-4d32-bba5-3d867e144ffb tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.755153 Nov 19 13:36:21.182263 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 23/46] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:20 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:21.200618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1329514021", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7d44de9-88f3-4c50-9fb4-20415f65d215"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:21.292652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-3ebaff4f-ddee-4eb0-951d-36b43f2d2083 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:21.298850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-3ebaff4f-ddee-4eb0-951d-36b43f2d2083 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for user 4e712519a9d54cee964e57814985b4ab and project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:21.325944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3ebaff4f-ddee-4eb0-951d-36b43f2d2083 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.176853 Nov 19 13:36:21.331169 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] validate_networks() for [('b7d44de9-88f3-4c50-9fb4-20415f65d215', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:36:21.353146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 24/47] 10.222.0.74 () {62 vars in 1198 bytes} [Fri Nov 19 13:36:20 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1206 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 13:36:21.392449 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:21.393874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:21.403569 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:21.404306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:21.406098 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:21.406958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:21.778451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:21.794558 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-75526d8a-363e-415a-88c8-9bbb7a602ee6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.418835 Nov 19 13:36:21.795737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 25/48] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:21 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:21.904850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d3fde603-89ac-4974-a4b8-a3a18e912a07 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: .version_select at 0x7fb42a8bfd30>, body: {"keypair": {"name": "tempest-keypair-316648945"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:21.959073 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-d3fde603-89ac-4974-a4b8-a3a18e912a07 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:21.971306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-d3fde603-89ac-4974-a4b8-a3a18e912a07 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for user 61c357c1b48a4305bce5451ee68de6e4 and project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:22.210662 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:36:22.213222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:36:22.214238 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:36:22.214854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:36:22.215961 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:36:22.244740 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:22.245359 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:22.246824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:22.248602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:22.350472 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Getting quotas for project dfe06ab44f6d441fbd48e98b2ba2119b. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:22.373806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Getting quotas for user ec0e8eed657b4628a26887809588106e and project dfe06ab44f6d441fbd48e98b2ba2119b. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:22.404440 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-d3fde603-89ac-4974-a4b8-a3a18e912a07 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:22.410449 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-d3fde603-89ac-4974-a4b8-a3a18e912a07 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for user 61c357c1b48a4305bce5451ee68de6e4 and project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:22.430365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:36:22.434357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:36:22.452005 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d3fde603-89ac-4974-a4b8-a3a18e912a07 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.655061 Nov 19 13:36:22.456405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 26/49] 10.222.0.74 () {60 vars in 1157 bytes} [Fri Nov 19 13:36:21 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:22.466696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:22.467636 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:22.488992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:22.491292 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:22.493084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:22.495912 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:22.657042 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-528dde98-cd0c-4a5e-ab98-c000a56b6a6e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.461359 Nov 19 13:36:22.665831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 24/50] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:36:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:36:22.678155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-34e0d3d7-4ae1-45b7-99f0-1b188ff4e81a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:22.680408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-34e0d3d7-4ae1-45b7-99f0-1b188ff4e81a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:22.879800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-34e0d3d7-4ae1-45b7-99f0-1b188ff4e81a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:22.930469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-34e0d3d7-4ae1-45b7-99f0-1b188ff4e81a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1222 microversion: 2.1 time: 0.255738 Nov 19 13:36:22.948755 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 25/51] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:22 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1222 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:22.958990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:22.984012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:23.013076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:23.017089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:23.021014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:23.023224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:23.612413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:23.647760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e7450946-6683-4e8a-9894-c48b2a5b9f94 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 1.165384 Nov 19 13:36:23.647760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 27/52] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:22 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:23.971662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:23.981231 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:23.990720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:23.993149 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:23.995895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:23.997226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:24.392950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:24.402729 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0b308740-2e38-4729-821c-f7a6f9e4ccae tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1226 microversion: 2.1 time: 0.456442 Nov 19 13:36:24.421351 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 28/53] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:23 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1226 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:24.521497 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:24.533391 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2757cebf-6a29-4423-b916-d98bd083e35a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 1.581126 Nov 19 13:36:24.546131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 26/54] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:22 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:24.664022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:24.665805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:24.682889 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:24.683952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:24.684972 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:24.685574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:25.427942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:25.429066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:25.439047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:25.445734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:25.452546 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:25.453495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:25.880170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:25.888695 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1dbdbd1f-e804-49f4-926d-a6fc30a8f606 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1280 microversion: 2.1 time: 0.465075 Nov 19 13:36:25.904829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 27/55] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:25 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1280 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:25.920654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:25.921281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:25.941007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:25.941756 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:25.942982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:25.947884 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:26.350230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:26.366989 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c11e125d-d44e-4e87-83e3-c333fc05f901 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 1.710075 Nov 19 13:36:26.371414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 29/56] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:24 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:26.779413 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:26.787864 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b0e775c-5b6d-4978-9fea-43b686f2e440 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.881805 Nov 19 13:36:26.792127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 28/57] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:25 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:26.914678 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:26.917042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:26.944359 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:26.947117 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:26.950921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:26.953161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:27.319774 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:27.332046 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-586fc080-bc17-43d6-a361-f159d2669868 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1280 microversion: 2.1 time: 0.429442 Nov 19 13:36:27.346403 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 30/58] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:26 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1280 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:27.387689 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:27.388357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:27.400096 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:27.402752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:27.403797 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:27.405836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:27.809408 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:27.810474 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:27.821390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:27.821832 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:27.824218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:27.825478 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:28.117067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:28.129364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e292f40f-d018-4b09-b023-88cea1a99624 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.747583 Nov 19 13:36:28.130821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 29/59] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:27 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:28.326801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-17c63c26-7037-49ba-8a98-a7e9d5baf9cb req-88495e9c-eee6-43d3-8385-350a6ca4c236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0e9fcb-022c-4369-8d5e-b644024f55aa", "tag": "14ba1da9-a1bd-4d76-a1b8-660a0f7015d0"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:28.329314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:28.329314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:36:28.355492 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-17c63c26-7037-49ba-8a98-a7e9d5baf9cb req-88495e9c-eee6-43d3-8385-350a6ca4c236 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:28.356187 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-17c63c26-7037-49ba-8a98-a7e9d5baf9cb req-88495e9c-eee6-43d3-8385-350a6ca4c236 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:28.385798 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-17c63c26-7037-49ba-8a98-a7e9d5baf9cb req-88495e9c-eee6-43d3-8385-350a6ca4c236 service nova] Creating event network-changed:14ba1da9-a1bd-4d76-a1b8-660a0f7015d0 for instance df0e9fcb-022c-4369-8d5e-b644024f55aa on hv-cinder-81735 Nov 19 13:36:28.386815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-17c63c26-7037-49ba-8a98-a7e9d5baf9cb req-88495e9c-eee6-43d3-8385-350a6ca4c236 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 13:36:28.394565 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:28.395982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:28.398177 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:28.398785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:28.426969 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.compute.rpcapi [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 13:36:28.431449 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=122814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 13:36:28.483992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9345da0b-eabc-4d50-9470-c4940e2171a7 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338427 Nov 19 13:36:28.485876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 30/60] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:28.499250 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-715707082", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd895079-04e8-47ee-af89-1a706b94b509"}], "security_groups": [{"name": "tempest-securitygroup--616223579"}], "key_name": "tempest-keypair-2038749566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:28.508334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:28.542680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e5102915-2d89-4078-8797-ad4ca0216155 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.732530 Nov 19 13:36:28.546260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 31/61] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:27 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:28.552098 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:28.554484 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:28.565717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:28.568900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:28.572763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:28.573639 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:29.028191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:29.038570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e3939984-a3f5-42cd-b548-e45c09be5ae9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1280 microversion: 2.1 time: 0.491142 Nov 19 13:36:29.045283 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 32/62] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:28 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:29.146640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:29.147318 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:29.169494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:29.170149 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:29.171059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:29.171609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:29.190682 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] validate_networks() for [('bd895079-04e8-47ee-af89-1a706b94b509', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:36:29.916832 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:29.929666 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2daae596-952c-4e06-bb92-6297cdca2961 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.786673 Nov 19 13:36:29.935292 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 33/63] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:29 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:30.659580 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-02e79b91-d778-4c2e-b72a-80079efceffd req-c4bb99ab-8a99-4c8a-804d-bec0e09257cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0527068f-4ff5-4f91-a46f-230af0c3acf5", "tag": "9023ca54-c0e3-4003-874d-a7a129614a25"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:30.666973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:30.666973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:36:30.695484 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-02e79b91-d778-4c2e-b72a-80079efceffd req-c4bb99ab-8a99-4c8a-804d-bec0e09257cd service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:30.696376 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-02e79b91-d778-4c2e-b72a-80079efceffd req-c4bb99ab-8a99-4c8a-804d-bec0e09257cd service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:30.711742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:36:30.712603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:36:30.712730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:36:30.713187 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:36:30.713572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:36:30.740317 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:30.741942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:30.742848 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:30.743326 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:30.816418 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for project be95e890da954a74b914b3e0aef316c1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:30.818328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-02e79b91-d778-4c2e-b72a-80079efceffd req-c4bb99ab-8a99-4c8a-804d-bec0e09257cd service nova] Creating event network-changed:9023ca54-c0e3-4003-874d-a7a129614a25 for instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 on hv-cinder-81735 Nov 19 13:36:30.821686 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for user 4e712519a9d54cee964e57814985b4ab and project be95e890da954a74b914b3e0aef316c1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:30.822200 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-02e79b91-d778-4c2e-b72a-80079efceffd req-c4bb99ab-8a99-4c8a-804d-bec0e09257cd service nova] Acquired lock "compute-rpcapi-router" {{(pid=122815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 13:36:30.832543 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:30.836808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:30.838944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:30.842520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:30.863052 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.compute.rpcapi [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 13:36:30.887127 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] Releasing lock "compute-rpcapi-router" {{(pid=122815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 13:36:30.894401 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:36:30.898770 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:36:30.987595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ae6195f4-e36b-4f9b-b5fa-c77550688034 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.049981 Nov 19 13:36:30.988638 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 34/64] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:30.998598 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:30.999830 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:31.019838 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:31.024003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:31.025339 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:31.035137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:31.103335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e726339c-bae1-4632-aa24-846236afeb74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.607389 Nov 19 13:36:31.104456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 31/65] 10.222.0.74 () {62 vars in 1187 bytes} [Fri Nov 19 13:36:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 13:36:31.128945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:31.129493 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:31.140997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:31.141464 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:31.142290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:31.142734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:31.725345 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:31.742370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-17dd4d4d-0740-4ca9-a62c-64e767c4efd9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1280 microversion: 2.1 time: 0.636708 Nov 19 13:36:31.762106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 32/66] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:31 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1280 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:31.776355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:31.777054 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:31.797251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:31.797706 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:31.798511 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:31.808230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:32.410974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:32.425980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3b5d5a48-e913-4908-a643-65f9e64c6d75 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 1.436004 Nov 19 13:36:32.426816 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 35/67] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:30 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:32.441408 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:32.442567 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:32.456295 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:32.456770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:32.459953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:32.462544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:32.471908 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:32.479909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9abaa553-8a5d-4a2c-9f65-dd7038222fc8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.716608 Nov 19 13:36:32.483383 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 33/68] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:31 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:32.491225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-106310116", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e8d3ce8-6200-409f-8036-c10d558c4d7e"}], "security_groups": [{"name": "tempest-securitygroup--257473259"}], "key_name": "tempest-keypair-316648945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:32.799020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:32.812681 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:32.814922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:32.817191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bc9f9205-7ae1-43b2-9279-a488d93df44d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1277 microversion: 2.20 time: 0.387979 Nov 19 13:36:32.817845 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 36/69] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:32 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:32.823880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:32.824798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:32.833754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:32.834875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:32.836990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:32.837752 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:32.838900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] validate_networks() for [('2e8d3ce8-6200-409f-8036-c10d558c4d7e', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:36:33.190118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.201113 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-30fd2d41-5aef-4dee-bad6-0ce4511b46c7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.381568 Nov 19 13:36:33.201705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 37/70] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:32 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:33.436467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:36:33.437332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:36:33.438615 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:36:33.439806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:36:33.440529 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:36:33.446452 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:33.447045 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:33.454691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.455861 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.457087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.457589 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.462672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.465647 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.466596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.469161 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.517829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for project 5a84768546e2479ab48c55cca9d00d88. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:36:33.522677 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for user 61c357c1b48a4305bce5451ee68de6e4 and project 5a84768546e2479ab48c55cca9d00d88. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:36:33.535619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:36:33.538928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:36:33.616980 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-67b9e0c5-128c-4e5f-aec1-e7c7041f0bae tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.129806 Nov 19 13:36:33.618053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 34/71] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:36:32 2021] POST /compute/v2.1/servers => generated 401 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:36:33.628482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:33.629377 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:33.636895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.637585 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.638612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.639301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.730690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.741391 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ffe17df4-8df7-4f1e-bc8e-79154290c210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.296844 Nov 19 13:36:33.742012 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 38/72] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:33 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:33.749899 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e255dc16-3bd1-4382-9838-210da861a088 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:33.750529 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e255dc16-3bd1-4382-9838-210da861a088 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:33.819284 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.837230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de45c478-4485-4ea1-89d7-39150e88c4f4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.212400 Nov 19 13:36:33.843649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 35/73] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:33 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:33.859732 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e255dc16-3bd1-4382-9838-210da861a088 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.866239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:33.867758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e255dc16-3bd1-4382-9838-210da861a088 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1236 microversion: 2.1 time: 0.124618 Nov 19 13:36:33.868815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 39/74] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:33 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:33.870933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:33.880989 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.881554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.883192 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:33.883910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:33.969719 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.991512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.993055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:33.994204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-99a7b281-b7d4-403f-a3fe-1895ba661f6c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1277 microversion: 2.20 time: 0.136945 Nov 19 13:36:33.999370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 36/75] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:33 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:34.219465 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:34.220009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:34.232014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.232500 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.233306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.233760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.390770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:34.410172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e4c9b81a-14cb-4c4d-b477-c09589d8db85 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.194741 Nov 19 13:36:34.411336 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 40/76] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:34 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:34.759960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:34.760589 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:34.767320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.767890 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.768871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.769372 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.855253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:34.855253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:34.861677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.862279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.863414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.864123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.946101 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:34.954701 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b8feb9ee-1382-4b0a-a9f1-3bc655a52f62 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.198747 Nov 19 13:36:34.966977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 37/77] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:34 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:34.970922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:34.971624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:34.981817 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.982268 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:34.983060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:34.983519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:35.062019 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:35.065852 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:35.071189 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-be6901c4-f293-4821-b592-c1e197a717b5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1240 microversion: 2.1 time: 0.104111 Nov 19 13:36:35.071997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 38/78] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:34 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:35.074939 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dfcfda61-6a6e-4822-a4af-136c7806e7c6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.224491 Nov 19 13:36:35.075879 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 41/79] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:34 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:35.079309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:35.080323 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:35.087416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:35.087873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:35.088664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:35.089100 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:35.160454 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:35.170425 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:35.172265 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:35.173684 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de4936c0-d9cb-41cf-a657-089eda4fff55 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1277 microversion: 2.20 time: 0.100547 Nov 19 13:36:35.184807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 39/80] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:35 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:35.427461 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:35.428368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:35.438547 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:35.440740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:35.454556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:35.455021 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:35.732520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:35.742554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-712096d0-0ed4-4987-ba04-8bf78221a0f1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.319266 Nov 19 13:36:35.746937 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 42/81] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:35 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:35.973651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:35.974576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:35.981120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:35.994866 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:35.996106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:35.996751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.093910 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:36.094624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:36.101455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.102162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.103055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.104258 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.199880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:36.217271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3598bba4-3182-4675-a029-9644d6cf4fa3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1288 microversion: 2.1 time: 0.132200 Nov 19 13:36:36.217891 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 43/82] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:36 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1288 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:36.227810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:36.232515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:36.255250 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.255722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.256574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.257029 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.450296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:36.465435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-df9d05cd-4733-4e8b-b13a-04e1302f1fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.494270 Nov 19 13:36:36.467246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 40/83] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:35 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:36.476166 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:36.477362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:36.487674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.488675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.489861 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.491259 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.695603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:36.714040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:36.720426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:36.721652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bd16cd95-d044-46ca-b6fc-e2e760de5aef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1339 microversion: 2.20 time: 0.252970 Nov 19 13:36:36.725498 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 41/84] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:36 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1339 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:36.735769 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:36.748230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b34f60c5-fa1c-498e-8281-9873185fb501 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.527350 Nov 19 13:36:36.748733 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 44/85] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:36 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:36.763230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:36.764404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:36.784076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.784900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:36.789370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:36.790327 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.236739 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:37.237761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:37.247887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.248339 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.252106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.252554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.475980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:37.486301 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-143eadb1-0078-4fe7-8537-1a50ebd917e9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1294 microversion: 2.1 time: 0.255004 Nov 19 13:36:37.487519 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 45/86] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:37 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1294 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:37.494448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:37.495147 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:37.504091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.504777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.505888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.506704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.508627 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:37.517696 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-220d66f2-a970-4a7e-90a6-f841ab37a5d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.758232 Nov 19 13:36:37.520881 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 42/87] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:36 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:37.743525 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:37.744131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:37.749969 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.750601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.751411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.751844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.774170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:37.796660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8c2a543a-c5e9-4b65-8e6e-dd45a7ec3ad7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.307779 Nov 19 13:36:37.797278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 46/88] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:37 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:37.802298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:37.803125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:37.810314 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.810757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.811567 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.813235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:37.842995 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:37.851652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:37.853157 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:37.854281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3749d465-ceb3-426f-ad5f-0ba49de46ab9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1339 microversion: 2.20 time: 0.115246 Nov 19 13:36:37.854848 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 43/89] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:37 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:36:37.977473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-9d7bb097-b63a-42ef-b856-14fda9dd5df7 req-db3f8cae-65d1-401f-8870-d0ddf42e3ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7b2c50-f670-44be-bd04-8568a80c19a6", "tag": "fec92600-3dc3-4e88-b748-97fe65ccb089"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:37.980346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:37.980346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:36:37.990455 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-9d7bb097-b63a-42ef-b856-14fda9dd5df7 req-db3f8cae-65d1-401f-8870-d0ddf42e3ddc service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:37.992827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-9d7bb097-b63a-42ef-b856-14fda9dd5df7 req-db3f8cae-65d1-401f-8870-d0ddf42e3ddc service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.010579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-9d7bb097-b63a-42ef-b856-14fda9dd5df7 req-db3f8cae-65d1-401f-8870-d0ddf42e3ddc service nova] Creating event network-changed:fec92600-3dc3-4e88-b748-97fe65ccb089 for instance dc7b2c50-f670-44be-bd04-8568a80c19a6 on hv-cinder-81735 Nov 19 13:36:38.020495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-9d7bb097-b63a-42ef-b856-14fda9dd5df7 req-db3f8cae-65d1-401f-8870-d0ddf42e3ddc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048217 Nov 19 13:36:38.021261 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 44/90] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:38.048534 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:38.057445 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a0c2a040-82b5-4325-8eca-468fb65e9656 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.258782 Nov 19 13:36:38.058481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 47/91] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:37 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:38.504703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:38.505736 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:38.514752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.515397 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.516022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.516457 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.539045 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:38.539701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:38.552057 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.553311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.555322 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.556191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.756975 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:38.765314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-14f48f75-6edc-4718-865f-97aac1c1db18 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.264544 Nov 19 13:36:38.765921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 45/92] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:38 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:38.781734 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:38.789541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-915660d7-807e-4354-bb91-51c527f42322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.255308 Nov 19 13:36:38.790119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 48/93] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:38 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:38.815142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:38.815933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:38.822353 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.822829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.823664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.824149 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.872520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:38.873132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:38.880126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.880126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:38.880735 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:38.881360 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:39.012720 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:39.021049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b89dc8d4-ffe9-48ef-bf5e-64308bdf2e63 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.210870 Nov 19 13:36:39.021616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 46/94] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:38 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:39.064081 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:39.072985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:39.074785 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:39.075668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:39.076410 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9d36f2a0-b880-4fb8-9de1-bbf840e2b21c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.207714 Nov 19 13:36:39.076545 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:39.077020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 49/95] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:38 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:36:39.082584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:39.083034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:39.083991 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:39.084420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:39.230266 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:39.238523 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-02b2c0ba-db5a-4791-85aa-298d5c96e2b8 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.166737 Nov 19 13:36:39.239120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 47/96] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:39 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:39.782350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:39.782968 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:39.789370 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:39.789820 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:39.790595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:39.792017 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:39.805910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:39.806668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:39.814149 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:39.814601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:39.815430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:39.815928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.014819 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.024158 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-94e66e5d-86e3-4822-abe5-bbe501ec0ca3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.245547 Nov 19 13:36:40.024987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 50/97] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:39 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:40.030910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.044438 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:40.045030 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:40.046084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-918f88ee-eb5b-4de4-9963-d7d13327d458 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.243908 Nov 19 13:36:40.046949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 48/98] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:39 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:40.051409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-1dbffb39-bad4-446d-af94-c044807ca8ae req-212fb636-a14f-42d2-9eba-8686a50e6493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4794168-fa1e-43da-a27c-e5e83054dd1e", "tag": "77e22262-852e-4b88-94f2-ccf9b7f9c066"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:40.053551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:40.053551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:36:40.059708 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.060337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.060510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1dbffb39-bad4-446d-af94-c044807ca8ae req-212fb636-a14f-42d2-9eba-8686a50e6493 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.060955 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1dbffb39-bad4-446d-af94-c044807ca8ae req-212fb636-a14f-42d2-9eba-8686a50e6493 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.061164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.061601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.079485 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-1dbffb39-bad4-446d-af94-c044807ca8ae req-212fb636-a14f-42d2-9eba-8686a50e6493 service nova] Creating event network-changed:77e22262-852e-4b88-94f2-ccf9b7f9c066 for instance a4794168-fa1e-43da-a27c-e5e83054dd1e on hv-cinder-81735 Nov 19 13:36:40.085276 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-1dbffb39-bad4-446d-af94-c044807ca8ae req-212fb636-a14f-42d2-9eba-8686a50e6493 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037100 Nov 19 13:36:40.086138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 49/99] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:40.096963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:40.101290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:40.109193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.110006 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.111178 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.111805 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.270266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.279174 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-40a195f0-2ae2-4703-b721-335845dfa6e4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.238372 Nov 19 13:36:40.280003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 51/100] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:40 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:40.284522 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:40.285301 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:40.292343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.292798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.293594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:40.294034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:40.316946 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.330645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.333587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.335292 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f675a521-1be8-402b-ab66-7749c78d679d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.243749 Nov 19 13:36:40.336219 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 50/101] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:40 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:36:40.451341 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:40.459953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2a68787f-2f88-498a-abc1-be45df091b29 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.178719 Nov 19 13:36:40.460583 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 52/102] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:40 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:41.048984 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:41.049595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:41.058775 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.064029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.069326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:41.071185 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:41.072799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.073283 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.081771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.083400 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.085015 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.086380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.455544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:41.461119 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:41.468674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-81d893c0-6513-4d4a-9ced-89b9d1dc8cc0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.423426 Nov 19 13:36:41.481431 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6f5aad44-0cdb-4089-8c9f-bafb58da4e96 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.420223 Nov 19 13:36:41.482067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 51/103] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:41 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:41.482913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 53/104] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:41 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:41.490314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:41.490872 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:41.490996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:41.492057 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:41.499005 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.499482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.504619 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.506344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.507430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.508653 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.512146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.512840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.845138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:41.869313 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-919590b2-3d85-45d7-9205-dfd3e3d8c3af tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.386016 Nov 19 13:36:41.869904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 52/105] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:41 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:41.874836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:41.880953 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:41.894683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.897914 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.901352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:41.903064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:41.940351 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:41.958494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:41.960370 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:41.963331 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-29d72fa8-3d38-4303-a5a0-5e654b3a7055 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.478305 Nov 19 13:36:41.975059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 54/106] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:41 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:42.247022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-0f03d8e3-e2a5-4db8-8fa5-c44bb45d6c86 req-f8e66c13-b47c-4382-ba0f-666127540573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74979cdc-e64b-40da-8cf1-7f6311e51aec", "tag": "28e689cc-05d4-4dc9-a15e-6b1e27cf47b3"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:42.249382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:42.249382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:36:42.261157 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-0f03d8e3-e2a5-4db8-8fa5-c44bb45d6c86 req-f8e66c13-b47c-4382-ba0f-666127540573 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:42.261594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-0f03d8e3-e2a5-4db8-8fa5-c44bb45d6c86 req-f8e66c13-b47c-4382-ba0f-666127540573 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:42.292568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-0f03d8e3-e2a5-4db8-8fa5-c44bb45d6c86 req-f8e66c13-b47c-4382-ba0f-666127540573 service nova] Creating event network-changed:28e689cc-05d4-4dc9-a15e-6b1e27cf47b3 for instance 74979cdc-e64b-40da-8cf1-7f6311e51aec on hv-cinder-81735 Nov 19 13:36:42.310371 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-0f03d8e3-e2a5-4db8-8fa5-c44bb45d6c86 req-f8e66c13-b47c-4382-ba0f-666127540573 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066730 Nov 19 13:36:42.311453 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 55/107] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:42.488118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:42.488950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:42.505313 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:42.506432 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:42.507766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:42.511443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:42.532747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:42.549103 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d6c99947-1d3e-4464-a849-8dc1fe19258f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.676308 Nov 19 13:36:42.549992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 53/108] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:41 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:42.559646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:42.560701 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:42.572250 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:42.572621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:42.573465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:42.573895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.042604 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:43.054682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-610d26cf-86cc-4586-b9b2-adfa7e06ac60 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.570797 Nov 19 13:36:43.055750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 56/109] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:42 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:43.060688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:43.061644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:43.069493 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.070311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.071436 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.072104 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.097217 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:43.108440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a90b3a81-be06-45de-83a2-88bac54c08a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.554667 Nov 19 13:36:43.110450 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 54/110] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:42 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:43.129357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:43.131060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:43.156136 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.157284 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.158746 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.160444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.716258 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:43.732300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:43.732783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e6c3d1c3-7d28-42b2-9b40-b97356f3d3e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.675540 Nov 19 13:36:43.733174 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 57/111] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:43 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:43.749405 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:43.751186 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:43.752449 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0c5586ba-b154-4eed-a899-a45eba2cf21e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.639590 Nov 19 13:36:43.757803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 55/112] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:43 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:43.765987 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:43.769287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:43.782221 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.792123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.792903 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.793318 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.907023 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-210728ff-a137-4791-aba6-bd53d2b8b2ed req-60399537-5994-4254-8384-6211481787c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0527068f-4ff5-4f91-a46f-230af0c3acf5", "name": "network-vif-plugged", "status": "completed", "tag": "9023ca54-c0e3-4003-874d-a7a129614a25"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:43.910206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:43.910206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:36:43.920343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-210728ff-a137-4791-aba6-bd53d2b8b2ed req-60399537-5994-4254-8384-6211481787c2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:43.921010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-210728ff-a137-4791-aba6-bd53d2b8b2ed req-60399537-5994-4254-8384-6211481787c2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:43.964919 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-210728ff-a137-4791-aba6-bd53d2b8b2ed req-60399537-5994-4254-8384-6211481787c2 service nova] Creating event network-vif-plugged:9023ca54-c0e3-4003-874d-a7a129614a25 for instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 on hv-cinder-81735 Nov 19 13:36:43.987680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-210728ff-a137-4791-aba6-bd53d2b8b2ed req-60399537-5994-4254-8384-6211481787c2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245637 Nov 19 13:36:43.990091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 58/113] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:43.999367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-309d94f2-9e2e-427d-b216-1e02aab67fca req-3d0df09b-b639-4e82-b49e-8607550ddd46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:44.002780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:44.002780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:36:44.011874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-309d94f2-9e2e-427d-b216-1e02aab67fca req-3d0df09b-b639-4e82-b49e-8607550ddd46 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.012921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-309d94f2-9e2e-427d-b216-1e02aab67fca req-3d0df09b-b639-4e82-b49e-8607550ddd46 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.050851 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-309d94f2-9e2e-427d-b216-1e02aab67fca req-3d0df09b-b639-4e82-b49e-8607550ddd46 service nova] Creating event network-changed:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:36:44.056963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-309d94f2-9e2e-427d-b216-1e02aab67fca req-3d0df09b-b639-4e82-b49e-8607550ddd46 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064771 Nov 19 13:36:44.057813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 59/114] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:44.084942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:44.086667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:44.101454 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.102962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.110125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.110582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.565458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:44.572488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:44.591376 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9ae502ea-f0b5-49ee-963d-1e887ffae1f0 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.829045 Nov 19 13:36:44.594570 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 56/115] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:43 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:44.596407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bf87250d-e25b-48b5-889c-a01b5055ebbf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.517428 Nov 19 13:36:44.606843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 60/116] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:44 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:44.609688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:44.610218 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:44.624025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.624468 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.625307 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.625943 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.751986 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:44.752730 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:44.759711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.760061 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.760850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.761465 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.932280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:44.953680 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3b1848cd-6410-4988-9896-d46e749727e7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.357444 Nov 19 13:36:44.955323 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 57/117] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:44 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:44.982227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:44.983287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:44.992623 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.993422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:44.996054 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:44.996755 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:45.029401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:45.040392 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-db935ec2-2dde-47ba-b686-ca3294cdc800 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.293088 Nov 19 13:36:45.041546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 61/118] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:44 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:45.211889 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:45.226016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:45.227809 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:45.228960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f74eddb4-41ff-491a-a023-3061ec34c473 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.271412 Nov 19 13:36:45.229553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 58/119] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:44 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:45.613002 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:45.614177 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:45.614809 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:45.615298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:45.623729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:45.624588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:45.625118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:45.625921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:45.626026 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:45.626778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:45.627066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:45.627263 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.060488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.068701 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cf843ac1-1675-4169-bb6f-c93e490cd0ea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.458919 Nov 19 13:36:46.079437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 59/120] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:45 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:46.085273 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:46.086092 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:46.092290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.092979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.094156 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.094756 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.107327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.116255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0e955b2d-c66b-49e3-98da-ea42da0d82da tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1314 microversion: 2.1 time: 0.510505 Nov 19 13:36:46.116855 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 62/121] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:45 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:46.131167 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-946210f9-85a1-4242-9a50-ecc5004cc2d2 req-dd063218-d253-468a-b8ff-c21902bb073b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0e9fcb-022c-4369-8d5e-b644024f55aa", "name": "network-vif-plugged", "status": "completed", "tag": "14ba1da9-a1bd-4d76-a1b8-660a0f7015d0"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:46.132898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:46.132898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:36:46.141146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-946210f9-85a1-4242-9a50-ecc5004cc2d2 req-dd063218-d253-468a-b8ff-c21902bb073b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.141683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-946210f9-85a1-4242-9a50-ecc5004cc2d2 req-dd063218-d253-468a-b8ff-c21902bb073b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.154548 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-946210f9-85a1-4242-9a50-ecc5004cc2d2 req-dd063218-d253-468a-b8ff-c21902bb073b service nova] Creating event network-vif-plugged:14ba1da9-a1bd-4d76-a1b8-660a0f7015d0 for instance df0e9fcb-022c-4369-8d5e-b644024f55aa on hv-cinder-81735 Nov 19 13:36:46.159919 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-946210f9-85a1-4242-9a50-ecc5004cc2d2 req-dd063218-d253-468a-b8ff-c21902bb073b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041867 Nov 19 13:36:46.160523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 63/122] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:46.168172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:46.169028 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:46.188719 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.189169 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.190781 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.191622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.302788 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.311622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d4d8e784-c176-4992-ad11-bcdc2e4f5c89 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.230786 Nov 19 13:36:46.312208 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 60/123] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:46 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:46.318635 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:46.319468 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:46.351977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.355294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.356271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:46.357368 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:46.463777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.474524 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b34445a7-a7aa-4f8e-b73d-6ae40e55a056 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.312249 Nov 19 13:36:46.476618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 64/124] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:46 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:46.622305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.640211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.642685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:46.643851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-734b2efb-5e2c-4603-8ed7-bc69936a91aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.330017 Nov 19 13:36:46.644413 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 61/125] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:46 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:47.087070 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:47.087783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:47.096177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.098931 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.101985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.102678 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.134147 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:47.134753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:47.142669 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.143141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.144011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.144361 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.490147 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:47.498996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5bb12ded-c96b-4219-ba89-2a42f239fa58 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1501 microversion: 2.1 time: 0.369003 Nov 19 13:36:47.499760 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 62/126] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:47 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:47.503930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:47.505797 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:47.506542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:47.516135 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-68fef348-9642-414a-a855-1d888267dbd6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.433715 Nov 19 13:36:47.518723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.519160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 65/127] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:47 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:47.519664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.520785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.521872 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.530536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:47.531199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:47.540546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.553573 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.555508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.558361 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.787119 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:47.813386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7f37ed4c-8297-49b7-b90c-d70b26813ad9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.308929 Nov 19 13:36:47.814306 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 63/128] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:47 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:47.821227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:47.822254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:47.831256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:47.845597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.846264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.847524 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-924a7924-4818-4cc3-8b98-b309241d532e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1318 microversion: 2.1 time: 0.327099 Nov 19 13:36:47.850501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:47.852177 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:47.858811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 66/129] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:47 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:48.119615 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:48.127714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:48.129036 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:48.130275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-60e6a598-013a-4112-a206-091f3036f25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.314757 Nov 19 13:36:48.130867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 64/130] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:47 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:48.536539 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:48.537429 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:48.543986 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:48.544441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:48.545578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:48.546011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:48.777871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:48.791973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6d001b88-fcf6-44cf-8b77-2fa10cd854e4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.260033 Nov 19 13:36:48.792676 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 67/131] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:48 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:48.830677 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:48.831358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:48.840726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:48.841166 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:48.842718 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:48.843270 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:48.867482 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:48.868486 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:48.875373 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:48.875789 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:48.876940 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:48.877378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.100852 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:49.108481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b790e04a-4e8f-4d4c-912a-fa73fd169986 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.281826 Nov 19 13:36:49.118619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 65/132] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:48 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:49.132477 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:49.149421 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:49.150159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:49.161624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1f804243-2773-4a1e-aafc-1a8e8400b1c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1508 microversion: 2.1 time: 0.295438 Nov 19 13:36:49.163407 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.163861 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 68/133] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:48 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:49.166224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.167224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.168090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.200226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e68626bf-15ba-474b-9824-0fefb0f98cb2"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:49.201873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:49.226809 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.227551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.228224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.228824 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.439502 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:49.444158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:49.446578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:49.447773 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0c051b72-b7c7-42e4-9e05-d26e442c7499 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.303267 Nov 19 13:36:49.462598 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 66/134] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:49 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:36:49.468466 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-04949b66-8b6b-49af-957f-f8088492b409 req-87e8c9ca-9be9-4a35-a30c-b213b716834d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74979cdc-e64b-40da-8cf1-7f6311e51aec", "name": "network-vif-plugged", "status": "completed", "tag": "28e689cc-05d4-4dc9-a15e-6b1e27cf47b3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:49.470629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:49.470629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:36:49.480589 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-04949b66-8b6b-49af-957f-f8088492b409 req-87e8c9ca-9be9-4a35-a30c-b213b716834d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.481148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-04949b66-8b6b-49af-957f-f8088492b409 req-87e8c9ca-9be9-4a35-a30c-b213b716834d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.498106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-04949b66-8b6b-49af-957f-f8088492b409 req-87e8c9ca-9be9-4a35-a30c-b213b716834d service nova] Creating event network-vif-plugged:28e689cc-05d4-4dc9-a15e-6b1e27cf47b3 for instance 74979cdc-e64b-40da-8cf1-7f6311e51aec on hv-cinder-81735 Nov 19 13:36:49.507176 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-04949b66-8b6b-49af-957f-f8088492b409 req-87e8c9ca-9be9-4a35-a30c-b213b716834d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040785 Nov 19 13:36:49.508743 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 67/135] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:49.809017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:49.810018 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:49.828753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.833440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:49.834987 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:49.835849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:50.121761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6f5ca123-fa3f-4286-9b7c-1d4df8334a80 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "POST /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924935 Nov 19 13:36:50.127841 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 69/136] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:36:49 2021] POST /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:50.144144 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:50.144963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:50.153202 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:50.154512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:50.156308 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:50.157160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:50.185487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:50.196532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6f0fb10a-176d-4b83-9a1f-f71b0385254f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.391555 Nov 19 13:36:50.197460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 68/137] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:49 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:36:50.405984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:50.415494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bb0cca1a-cf7d-46ea-bbb0-d9d3edb258fd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.286023 Nov 19 13:36:50.424572 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 70/138] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:50 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:50.470047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:50.470735 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:50.477512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:50.477953 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:50.478734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:50.479397 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:50.720892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:50.731624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:50.733160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:50.734380 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fef3a357-05ee-43cf-a760-67813cf1afcb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.268402 Nov 19 13:36:50.735113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 69/139] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:50 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:36:51.088329 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a92564-cc3e-4b8b-9f4e-bbd42e7bf222"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:51.090315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:51.100038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.100778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.101792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.102414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.223621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:51.226814 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:51.264888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.272088 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.272981 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.273456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.458287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:51.467507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0af72a73-2666-455c-bf1f-167e327f6066 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1361 microversion: 2.1 time: 0.257464 Nov 19 13:36:51.468844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 70/140] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:51 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:51.473780 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:51.474737 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:51.481194 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.481616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.482697 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.483327 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.657000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:51.669414 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-70ae1247-7454-4267-87d1-9e37745288e5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.199241 Nov 19 13:36:51.669953 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 71/141] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:51 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:51.675536 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7b2c50-f670-44be-bd04-8568a80c19a6", "name": "network-vif-plugged", "status": "completed", "tag": "fec92600-3dc3-4e88-b748-97fe65ccb089"}, {"server_uuid": "a4794168-fa1e-43da-a27c-e5e83054dd1e", "name": "network-vif-plugged", "status": "completed", "tag": "77e22262-852e-4b88-94f2-ccf9b7f9c066"}, {"server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "name": "network-vif-plugged", "status": "completed", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:51.678253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:51.678253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:36:51.688499 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.689314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.717864 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] Creating event network-vif-plugged:fec92600-3dc3-4e88-b748-97fe65ccb089 for instance dc7b2c50-f670-44be-bd04-8568a80c19a6 on hv-cinder-81735 Nov 19 13:36:51.718906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] Creating event network-vif-plugged:77e22262-852e-4b88-94f2-ccf9b7f9c066 for instance a4794168-fa1e-43da-a27c-e5e83054dd1e on hv-cinder-81735 Nov 19 13:36:51.719632 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] Creating event network-vif-plugged:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:36:51.737473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-1b198d5f-411f-4383-a469-3c6144978367 req-64e6008a-1b07-486f-a550-e44ff35db8ac service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.066073 Nov 19 13:36:51.738206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 72/142] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:51.754828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:51.755810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:51.758612 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9cc91efc-d703-480a-810e-d014f13e3f5f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672815 Nov 19 13:36:51.761027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 71/143] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:36:51 2021] POST /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:51.763551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.764729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:51.765856 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:51.766477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.038827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:52.049556 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:52.051194 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:52.052726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-736f679d-73dd-4275-bf1a-5f6cfd8553ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.303873 Nov 19 13:36:52.064163 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 73/144] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:51 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:52.498632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:52.500101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:52.507010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:52.511267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.511267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:52.511267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.663239 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:52.670772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0a78586b-f019-4f1c-b239-d5929baa2d81 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1548 microversion: 2.1 time: 0.184017 Nov 19 13:36:52.671324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 72/145] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:52 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:52.687148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:52.688115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:52.694756 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:52.695339 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.696215 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:52.696322 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:52.696717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:52.696826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.703823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:52.704268 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.705041 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:52.705465 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:52.820992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e45cec85-8d43-4950-8306-68579e2064a0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128445 Nov 19 13:36:52.827787 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 73/146] 10.222.0.74 () {58 vars in 1274 bytes} [Fri Nov 19 13:36:52 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:52.881913 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:52.889498 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-73f06c79-bbcf-4960-8ba6-f4e701f3fc27 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.206017 Nov 19 13:36:52.893027 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 74/147] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:52 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:53.076353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:53.077309 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:53.092072 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:53.092702 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:53.096087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:53.096805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:53.317929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:53.326276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:53.328830 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:53.330142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-33e51ae3-b4fe-4099-b5ca-1381ad8d6fb2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.261600 Nov 19 13:36:53.330891 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 74/148] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:53 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:53.914265 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:53.917140 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:53.929061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:53.934021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:53.937728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:53.938510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:54.195471 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:54.204715 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4f053d5a-1e1c-4728-b5f7-58bfc23e3f20 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1322 microversion: 2.1 time: 0.296257 Nov 19 13:36:54.205800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 75/149] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:53 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:54.349364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:54.350008 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:54.362168 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:54.362616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:54.363892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:54.363892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:54.552089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:54.563308 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:54.565228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:54.566595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-26c96d38-4654-4bd6-b98c-c97518f90a68 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1406 microversion: 2.20 time: 0.221074 Nov 19 13:36:54.568014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 75/150] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:54 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:54.932333 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-d67429af-ee73-4ae7-af95-55036aa8049f req-0f0671ec-c9bb-4525-b5d6-876b7065c533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74979cdc-e64b-40da-8cf1-7f6311e51aec", "tag": "28e689cc-05d4-4dc9-a15e-6b1e27cf47b3"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:54.936080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:54.938031 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:54.939295 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:54.939295 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:36:54.948522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:54.949634 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:54.950748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:54.951275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:54.955988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-d67429af-ee73-4ae7-af95-55036aa8049f req-0f0671ec-c9bb-4525-b5d6-876b7065c533 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:54.963990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-d67429af-ee73-4ae7-af95-55036aa8049f req-0f0671ec-c9bb-4525-b5d6-876b7065c533 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:54.981176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-d67429af-ee73-4ae7-af95-55036aa8049f req-0f0671ec-c9bb-4525-b5d6-876b7065c533 service nova] Creating event network-changed:28e689cc-05d4-4dc9-a15e-6b1e27cf47b3 for instance 74979cdc-e64b-40da-8cf1-7f6311e51aec on hv-cinder-81735 Nov 19 13:36:54.993250 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-d67429af-ee73-4ae7-af95-55036aa8049f req-0f0671ec-c9bb-4525-b5d6-876b7065c533 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064598 Nov 19 13:36:54.999504 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 76/151] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:36:55.144509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e960af45-ff42-436d-92d2-fa4c4c9bc6b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.219451 Nov 19 13:36:55.146053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 76/152] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:36:54 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:36:55.232386 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:55.233921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:55.245607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.246457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.253882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.254875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.555315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:55.564504 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7111a506-6879-4e09-a7dc-d3145c901d11 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1515 microversion: 2.1 time: 0.338630 Nov 19 13:36:55.565418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 77/153] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:55 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1515 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:55.582911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:55.585641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:55.595554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:55.596781 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:55.600549 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.601005 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.601811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.602444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.614173 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.615070 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.616592 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.618895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.659683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lazy-loading 'flavor' on Instance uuid dc7b2c50-f670-44be-bd04-8568a80c19a6 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:36:55.831262 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:55.845111 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:55.847884 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:55.849558 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e97a0e01-9d9e-4c08-8fbf-011fb7f9a081 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1597 microversion: 2.20 time: 0.266560 Nov 19 13:36:55.863798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 78/154] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:36:55 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1597 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:36:55.869963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:55.870635 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:55.877952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.881356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.882280 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.882713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.892296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e06a9884-91c0-4165-b35e-abc1e2cb6190 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6/action" status: 200 len: 32 microversion: 2.1 time: 0.314014 Nov 19 13:36:55.893780 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 77/155] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:36:55 2021] POST /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6/action => generated 32 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:36:55.924272 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:55.924969 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:55.948188 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.949857 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:55.952868 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:55.953514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:56.098106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3c49caff-1d0f-487e-b47a-6d1baf8e301b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.232736 Nov 19 13:36:56.099194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 79/156] 10.222.0.74 () {60 vars in 1315 bytes} [Fri Nov 19 13:36:55 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:36:56.156253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:56.157507 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:56.164469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:56.165178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:56.166574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:56.167323 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:56.184500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:56.203446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-dfa0e5ea-322f-4a2c-8851-9319fb016597 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.304442 Nov 19 13:36:56.217322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 78/157] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:55 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:56.276356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5d3d6611-c43a-444a-8ff1-e261fcab526c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.123730 Nov 19 13:36:56.277319 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 80/158] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:36:56 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:36:57.224398 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:57.227382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:57.251690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:57.252466 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:57.255262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:57.255767 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:57.295255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:57.305551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:57.323001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:57.323933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:57.325568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:57.326703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:57.455594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2f47bba5-b380-4f59-8d6d-7b3e2682e335 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.171304 Nov 19 13:36:57.456432 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 81/159] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:36:57 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:36:57.620614 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:57.634702 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e0ea10c0-03d7-4aac-9e1f-07b8165f59db tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.415712 Nov 19 13:36:57.648081 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 79/160] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:57 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:58.166862 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:58.170139 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:58.184488 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.188525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.190494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.191854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-f4735db3-8106-45c6-afa3-09e91e36bfb3 req-e6f90165-e3f9-496c-9989-0438aaa66e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:58.192023 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.194026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:36:58.194026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:36:58.208450 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f4735db3-8106-45c6-afa3-09e91e36bfb3 req-e6f90165-e3f9-496c-9989-0438aaa66e54 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.211642 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-f4735db3-8106-45c6-afa3-09e91e36bfb3 req-e6f90165-e3f9-496c-9989-0438aaa66e54 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.235299 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-f4735db3-8106-45c6-afa3-09e91e36bfb3 req-e6f90165-e3f9-496c-9989-0438aaa66e54 service nova] Creating event network-changed:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:36:58.250652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-f4735db3-8106-45c6-afa3-09e91e36bfb3 req-e6f90165-e3f9-496c-9989-0438aaa66e54 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061874 Nov 19 13:36:58.265515 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 80/161] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:36:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:36:58.351396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-95949ff7-38a7-4c99-ac40-e7e406b61b62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.187252 Nov 19 13:36:58.353919 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 82/162] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:36:58 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:58.469742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:58.471125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:58.484862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.487622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.488802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.489385 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.626331 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3d21d912-5376-4bfd-81ef-24e69a6a003b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.162023 Nov 19 13:36:58.627626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 81/163] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:36:58 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:36:58.653921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:58.654971 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:58.667811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.670508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.671442 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:58.671876 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:58.886505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:58.896439 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4149405d-e92e-4532-91c0-1f40184abffd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.247056 Nov 19 13:36:58.898271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 83/164] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:58 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:59.069552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:59.070470 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:59.082130 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.084465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.085314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.086671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.121188 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:36:59.238241 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d2fb53c8-f60a-4ac1-befd-4d67396588a9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 204 len: 0 microversion: 2.1 time: 0.172519 Nov 19 13:36:59.242489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 82/165] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:36:59 2021] DELETE /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:36:59.247291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:59.248400 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:59.256791 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.257455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.259257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.259877 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.367340 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:59.368443 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:59.386689 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.387435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.389158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.390816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.422378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:36:59.435466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-037bc6bc-fd50-4dc4-9000-af882519cea4 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1553 microversion: 2.1 time: 0.189448 Nov 19 13:36:59.437072 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 84/166] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:59 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:59.507430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-671c402b-38ee-42a8-ac72-a6bc14a1c6c9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.144729 Nov 19 13:36:59.508073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 83/167] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:36:59 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:36:59.638646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:36:59.639658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:59.646138 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.646702 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.647881 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.649183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.757586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-df792416-a442-4838-9d8d-ff57083acbcd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.122515 Nov 19 13:36:59.761658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 85/168] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:36:59 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:36:59.914193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:36:59.914888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:36:59.922094 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.922851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:36:59.923904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:36:59.924587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.128558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:00.140199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e69317fc-442c-4a78-bd1d-d525987c21ad tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.228703 Nov 19 13:37:00.141126 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 84/169] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:36:59 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:00.459898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:00.460776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:00.470636 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:00.471401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.472329 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:00.472858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.517637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:00.518566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:00.527174 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:00.527994 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.528997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:00.529648 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.626017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0ac566c8-2218-41c0-8a84-a524eb5e6bd7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.111813 Nov 19 13:37:00.636515 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 85/170] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:00 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:00.657952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:00.666927 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0144bfe3-1397-4781-8488-fc5f6f56b30f tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1553 microversion: 2.1 time: 0.211208 Nov 19 13:37:00.669204 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 86/171] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:00 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:00.769726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:00.770767 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:00.777830 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:00.778270 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.779037 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:00.779485 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:00.886678 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b2c6960-674e-4216-9c9f-013c041e11e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.120922 Nov 19 13:37:00.887309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 86/172] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:00 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 13:37:01.157460 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:01.158061 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:01.165042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.165424 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.166198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.166627 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.322922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:01.348212 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-00837ca7-cc7e-4796-9441-5b1edd5e2928 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.193938 Nov 19 13:37:01.371321 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 87/173] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:01 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:01.646901 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:01.648548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:01.657530 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.658076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.658991 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.659797 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.727547 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:01.728683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:01.736040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.736539 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.738223 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.738660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.762993 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-febfbae8-0a9a-4d84-95b1-5881544cb75c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.122601 Nov 19 13:37:01.766590 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 87/174] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:01 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:01.902265 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:01.904111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:01.926444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.926898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.927732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:01.931117 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:01.931611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:01.951508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-deba04cc-3247-4a13-9d96-c7014a80dfce tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1553 microversion: 2.1 time: 0.227587 Nov 19 13:37:01.954792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 88/175] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:01 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:02.052579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9c0de7c9-c123-4504-b1f2-9b95863ef3a5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.157393 Nov 19 13:37:02.056214 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 88/176] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:01 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:37:02.366546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:02.367389 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:02.374857 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.375740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:02.376675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.377255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:02.542257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:02.558594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-739e885b-6575-4d22-af1f-1be27bf3638e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.195727 Nov 19 13:37:02.564856 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 89/177] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:02 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:02.671123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-efb5b010-901f-4c80-8ee9-f32d8a14d975 req-b1d9a5d1-568c-46a5-817b-a6688ebc68b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0527068f-4ff5-4f91-a46f-230af0c3acf5", "name": "network-vif-deleted", "tag": "9023ca54-c0e3-4003-874d-a7a129614a25"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:02.672703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:37:02.672703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:37:02.681511 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-efb5b010-901f-4c80-8ee9-f32d8a14d975 req-b1d9a5d1-568c-46a5-817b-a6688ebc68b9 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.681947 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-efb5b010-901f-4c80-8ee9-f32d8a14d975 req-b1d9a5d1-568c-46a5-817b-a6688ebc68b9 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:02.695835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-efb5b010-901f-4c80-8ee9-f32d8a14d975 req-b1d9a5d1-568c-46a5-817b-a6688ebc68b9 service nova] Creating event network-vif-deleted:9023ca54-c0e3-4003-874d-a7a129614a25 for instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 on hv-cinder-81735 Nov 19 13:37:02.700714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-efb5b010-901f-4c80-8ee9-f32d8a14d975 req-b1d9a5d1-568c-46a5-817b-a6688ebc68b9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Nov 19 13:37:02.701697 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 89/178] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:37:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:02.775914 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:02.778644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:02.787073 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.788054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:02.789534 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.790161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:02.969867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:02.970800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:02.977877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.978329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:02.979158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:02.979599 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:03.061912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:03.072518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-35f44bd3-09e7-4cae-9d55-7d4861422de9 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1511 microversion: 2.1 time: 0.107115 Nov 19 13:37:03.073255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 90/179] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:02 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1511 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:03.078058 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:03.079251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:03.085836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:03.086128 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:03.086915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:03.087398 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:05.335339 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2c83b686-92a1-4430-9315-70f02849926f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 2.564375 Nov 19 13:37:05.338761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 90/180] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:02 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:05.342688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:05.343043 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:05.348731 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-51c2e9f5-a20a-453b-ab72-a0bd8019d0d4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 2.273233 Nov 19 13:37:05.352350 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 91/181] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:03 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:37:05.357379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:05.357379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:05.360459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:05.361013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:05.363237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:05.363735 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:05.364352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:05.364904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:05.366902 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:05.367667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:05.448094 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:05.460802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-50545af7-6ab4-4109-8b2a-ba2ea8377742 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1345 microversion: 2.1 time: 0.109569 Nov 19 13:37:05.461982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 92/182] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:05 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:05.548459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:05.557605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-45b0b010-f308-4431-a9ac-39517d707bb6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.219768 Nov 19 13:37:05.558356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 91/183] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:05 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:06.360027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:06.361640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:06.365777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:06.366172 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:06.373382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.373824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.374638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.375795 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.382244 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.385601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.386581 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.399257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.505416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3a75bbb4-6d48-45aa-88a7-0b0d8d2e0c31 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.161262 Nov 19 13:37:06.506740 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 93/184] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:06 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:06.513472 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:06.518546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-09640ebf-bb37-404c-8f9a-04671da19c4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.161448 Nov 19 13:37:06.519331 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 92/185] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:06 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:37:06.524102 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:06.544256 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.545976 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.546947 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.548808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.576631 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:06.576982 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:06.592581 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.592992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.594089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.595030 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.630342 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:06.631164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:06.631436 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lazy-loading 'fault' on Instance uuid 0527068f-4ff5-4f91-a46f-230af0c3acf5 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:37:06.740419 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b51a1d61024e54be8bff35f39cf863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3eb64abd04110a6520c0499e7ce7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:06.748828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-69a189d2-c242-4413-9b07-4d19542b71f5 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 200 len: 1304 microversion: 2.1 time: 0.240646 Nov 19 13:37:06.749582 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 94/186] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:06 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 1304 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:06.825855 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:06.834184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6e51417c-2800-444c-a7dc-5a87c12ae050 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.262316 Nov 19 13:37:06.834805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 93/187] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:06 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:07.306626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-620235399", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "d4b5f30c-9859-4dc0-9964-fe81b0775d18"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:07.366979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] validate_networks() for [('d4b5f30c-9859-4dc0-9964-fe81b0775d18', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:37:07.517470 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:07.518386 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:07.526112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.527042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.528049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.528481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.609300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4c205810-03be-41ae-b545-2ed6211e4f47 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.095571 Nov 19 13:37:07.610305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 94/188] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:07 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:07.616905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:07.618164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:07.625035 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.625736 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.626705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.627393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.702318 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e0ef8990-77d9-441b-a85e-65031f85b3d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 14 microversion: 2.1 time: 0.090012 Nov 19 13:37:07.703207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 95/189] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:07 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:37:07.772607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:07.782151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:07.791759 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:37:07.793008 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:37:07.793547 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:37:07.794016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:37:07.794497 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:37:07.796219 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.798917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.803598 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.804125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.804896 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.805443 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.806338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.806833 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.821151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] HTTP exception thrown: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. Nov 19 13:37:07.821756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Returning 404 to user: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:37:07.822600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-076c4a9f-10a1-4c53-8e93-b631a18b1804 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 404 len: 111 microversion: 2.1 time: 0.057725 Nov 19 13:37:07.823499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 96/190] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:07 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:37:07.828090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:37:07.833854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for user 94c7c0bfd6f84b29b28fec4fcef50f41 and project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:37:07.848034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:37:07.851073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:37:07.853007 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:07.853776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:07.873815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.875035 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.878446 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:07.879050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:07.965149 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e796bc13-61ae-4cc7-ac49-b8eab305df83 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664162 Nov 19 13:37:07.965850 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 95/191] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:37:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:37:07.983671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f2f7e2f8-1d8c-4a54-864f-88f9154182c8 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:07.987510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f2f7e2f8-1d8c-4a54-864f-88f9154182c8 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:08.061738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f2f7e2f8-1d8c-4a54-864f-88f9154182c8 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:08.070663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f2f7e2f8-1d8c-4a54-864f-88f9154182c8 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1217 microversion: 2.1 time: 0.097588 Nov 19 13:37:08.071775 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 96/192] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:07 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:08.077247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:08.078242 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:08.085473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:08.085951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:08.087169 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:08.088086 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:08.102997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] HTTP exception thrown: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. Nov 19 13:37:08.103645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Returning 404 to user: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:37:08.104541 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f69e23ca-d221-4ccd-a0c9-af4fbf6c83d6 tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031722 Nov 19 13:37:08.105030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 97/193] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:37:08 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:37:08.184577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:08.193929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4e9e8499-4004-47ee-b30e-9cc59b81e084 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.345669 Nov 19 13:37:08.194521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 97/194] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:07 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:08.621797 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:08.623548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:08.630551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:08.638716 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:08.641074 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:08.641738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:08.713842 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:08.714797 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:08.721145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:08.721845 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:08.722803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:08.723587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:08.729261 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-172b3e5d-5b07-4aa8-a76f-5447b4bcdae9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.111723 Nov 19 13:37:08.730877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 98/195] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:08 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:08.827834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-add1ae71-8ee2-4f46-a79e-03cc615fc5f5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 1299 microversion: 2.1 time: 0.117647 Nov 19 13:37:08.828500 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 98/196] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:08 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:09.090220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:09.091637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:09.101123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.101840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.103018 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.103813 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.190022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:09.198795 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d3148523-daeb-45f8-aa34-bc1c0451c569 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1269 microversion: 2.1 time: 0.113593 Nov 19 13:37:09.199637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 99/197] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:09 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:09.223259 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:09.227869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:09.239156 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.239675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.240722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.241468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.450026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:09.450543 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:09.456796 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.461866 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.463167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.465963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.490125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] HTTP exception thrown: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. Nov 19 13:37:09.491234 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Returning 404 to user: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:37:09.497099 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6822e674-9d4f-4d64-a15b-0387c9fd7cbf tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 404 len: 111 microversion: 2.1 time: 0.051106 Nov 19 13:37:09.497771 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 100/198] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:37:09 2021] DELETE /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:37:09.508222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:09.508842 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] [instance: 0527068f-4ff5-4f91-a46f-230af0c3acf5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:09.515895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.516333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.517308 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.517928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.520837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:09.530411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5c36094d-1d08-450c-8966-46de20fbcd75 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.322034 Nov 19 13:37:09.531042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 99/199] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:09 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:09.534413 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] HTTP exception thrown: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. Nov 19 13:37:09.535231 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] Returning 404 to user: Instance 0527068f-4ff5-4f91-a46f-230af0c3acf5 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:37:09.536124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f9cb06f7-7554-4f8c-8277-b8ee775a3c7b tempest-DeleteServersTestJSON-1195764150 tempest-DeleteServersTestJSON-1195764150-project] 10.222.0.74 "GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5" status: 404 len: 111 microversion: 2.1 time: 0.034046 Nov 19 13:37:09.539139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 101/200] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:09 2021] GET /compute/v2.1/servers/0527068f-4ff5-4f91-a46f-230af0c3acf5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:37:09.742851 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:09.743994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:09.761515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.762943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.770915 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.771559 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.840531 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:09.841976 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:09.851022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.852161 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.853499 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:09.854512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:09.870368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-db7699dd-5f15-4b8d-9fb0-09cfa4efc31e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.131878 Nov 19 13:37:09.873490 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 100/201] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:09 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:09.954831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4bcd4854-0f88-491b-9df0-6a7e8da1671a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 7043 microversion: 2.1 time: 0.118351 Nov 19 13:37:09.960608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 102/202] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:09 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 7043 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:10.218448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:10.219123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:10.226518 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.227018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.228049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.228699 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.504609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:10.514324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c2961c6d-cf52-4325-a57c-7eed6e143e50 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.299985 Nov 19 13:37:10.525601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 101/203] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:10 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:10.550225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:10.551185 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:10.572230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.572766 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.573854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.574320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.822109 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:10.829964 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2c4fc5d9-0e94-4aae-a7c9-0195523a5e7d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.284619 Nov 19 13:37:10.831427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 103/204] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:10 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:10.888167 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:10.889177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:10.896278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.897104 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.898092 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.898671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.970203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:10.971733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:10.978571 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.979245 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.980199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:10.981074 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:10.993691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-73fbeece-b62b-431d-84a5-525d8adee319 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14 microversion: 2.20 time: 0.110387 Nov 19 13:37:10.997266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 102/205] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:10 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:11.102346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c28a4d5d-0eb5-4d98-bfd1-a7d8e28b1bee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 10893 microversion: 2.1 time: 0.137511 Nov 19 13:37:11.103532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 104/206] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:10 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 10893 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:37:11.413259 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-e373bd52-7541-4306-ad6d-4fe8830dfbd3 req-50f2c2b8-c012-4fe1-ba00-6aaa3eb681fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc664a9-a9d4-4827-9bb5-94c81531a0e5", "tag": "b5edbcfa-b003-4f23-9e31-e4f781f893f8"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:11.427642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:37:11.427642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:37:11.439625 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-e373bd52-7541-4306-ad6d-4fe8830dfbd3 req-50f2c2b8-c012-4fe1-ba00-6aaa3eb681fe service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:11.440429 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-e373bd52-7541-4306-ad6d-4fe8830dfbd3 req-50f2c2b8-c012-4fe1-ba00-6aaa3eb681fe service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:11.455457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-e373bd52-7541-4306-ad6d-4fe8830dfbd3 req-50f2c2b8-c012-4fe1-ba00-6aaa3eb681fe service nova] Creating event network-changed:b5edbcfa-b003-4f23-9e31-e4f781f893f8 for instance 9dc664a9-a9d4-4827-9bb5-94c81531a0e5 on hv-cinder-81735 Nov 19 13:37:11.460799 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-e373bd52-7541-4306-ad6d-4fe8830dfbd3 req-50f2c2b8-c012-4fe1-ba00-6aaa3eb681fe service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055730 Nov 19 13:37:11.463813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 103/207] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:37:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:11.534716 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:11.535486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:11.547130 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:11.547586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:11.548551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:11.549178 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:11.721102 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:11.729583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5a83a185-3f67-4957-9d12-c0c79691fc06 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.199207 Nov 19 13:37:11.741300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 105/208] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:11 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:11.849099 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:11.849969 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:11.857090 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:11.857882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:11.858849 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:11.859702 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:12.029073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:12.031532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:12.039815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:12.040436 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:12.041762 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:12.041994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:12.043472 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:12.050863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-189d58a6-8328-4938-9879-3cc2c7e1d81f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.207099 Nov 19 13:37:12.052286 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 104/209] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:11 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:12.113897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:12.115053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:12.121546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:12.121966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:12.122803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:12.123414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:14.485360 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-190012e7-93c1-4a6b-a687-0e8446940822 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 6451 microversion: 2.20 time: 2.483214 Nov 19 13:37:14.486659 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 106/210] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:12 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 6451 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:37:14.492499 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:14.493341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:14.504579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-116991d8-24de-4897-80e6-ee4239e08ead tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 17250 microversion: 2.1 time: 2.394112 Nov 19 13:37:14.505880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 105/211] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:12 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 17250 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:37:14.510901 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:14.511662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:14.515259 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:14.515717 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:14.519712 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:14.521279 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:14.531172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:14.531621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:14.532429 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:14.533039 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:14.734277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:14.741982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:14.743275 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ceeca972-946f-4c19-8a83-60215ed41fac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.236240 Nov 19 13:37:14.752089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0511b9b0-1e7e-4107-abb3-3396d36a6250 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.262843 Nov 19 13:37:14.752089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 107/212] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:14 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:14.752617 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 106/213] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:14 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:14.909510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cb0ede9d-c901-4bb1-a2b4-958636c23ba2 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb42a7915e0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:14.977761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cb0ede9d-c901-4bb1-a2b4-958636c23ba2 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2baf8a54-fc34-4e7b-990d-de92484c1816" status: 200 len: 351 microversion: 2.1 time: 0.073852 Nov 19 13:37:14.978664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 108/214] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:37:14 2021] GET /compute/v2.1/os-volumes/2baf8a54-fc34-4e7b-990d-de92484c1816 => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:15.498167 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:15.499108 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:15.505352 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.506025 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.506530 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.506963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.517304 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:15.518614 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:15.532370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.533357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.534542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.535048 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.628644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9b63779f-455c-4bfa-a679-5dfe22fa23f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 10414 microversion: 2.20 time: 0.134582 Nov 19 13:37:15.629444 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 107/215] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:15 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 10414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:15.665553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-407e5298-543c-42b0-8c08-a1da42ae06d5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 17808 microversion: 2.1 time: 0.152621 Nov 19 13:37:15.668481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 109/216] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:15 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 17808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:37:15.761291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:15.762160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:15.772049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.772679 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.773590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.774220 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.774917 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:15.775898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:15.785929 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.786694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:15.787609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:15.788411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:16.003684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:16.009187 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:16.012786 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-af00e7bf-99c4-490a-8939-aed4882ab971 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.255152 Nov 19 13:37:16.020533 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 108/217] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:15 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:16.020926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f55ebdb3-d775-4c86-8684-032d0557d2aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.250847 Nov 19 13:37:16.020926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 110/218] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:15 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:16.448556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c6cca7ad-8b46-4377-b400-cef2f8c5f631 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb429fbca60>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:16.509271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c6cca7ad-8b46-4377-b400-cef2f8c5f631 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/50fab359-8bbf-4636-aa00-0fbb4a6502c1" status: 200 len: 351 microversion: 2.1 time: 0.064430 Nov 19 13:37:16.510038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 109/219] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:37:16 2021] GET /compute/v2.1/os-volumes/50fab359-8bbf-4636-aa00-0fbb4a6502c1 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:16.642106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:16.643061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:16.651023 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:16.651508 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:16.652526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:16.653072 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:16.677571 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:16.679247 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:16.687665 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:16.688558 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:16.689590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:16.690066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:16.746859 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0560a51c-2c32-4e4f-acb8-e321368264e2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 14631 microversion: 2.20 time: 0.109328 Nov 19 13:37:16.752364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 111/220] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:16 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 14631 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:16.815178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-daec3354-f43d-4220-9389-690f7c42a628 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 19342 microversion: 2.1 time: 0.140874 Nov 19 13:37:16.816234 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 110/221] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:16 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 19342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:17.032597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:17.033416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:17.038645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:17.039510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:17.040953 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.041584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.042422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.042860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.046736 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.047326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.048369 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.048992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.257538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:17.261580 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:17.268389 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-06a16d95-3d91-47fc-a2ff-9e996a40e0d4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.235577 Nov 19 13:37:17.269249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 111/222] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:17 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:17.269760 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7bb32cc2-25dc-4a2e-bfb7-b1170b224778 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.242348 Nov 19 13:37:17.270452 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 112/223] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:17 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:17.760697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:17.761720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:17.768562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.769004 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.769787 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.770214 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.828022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:17.828954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:17.837764 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.838489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.839830 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:17.840519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:17.862662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e6337687-41ae-49f8-8003-ea4a13940b5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 16721 microversion: 2.20 time: 0.099718 Nov 19 13:37:17.862662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 112/224] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:17 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 16721 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:17.911242 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-78fa8411-1c5f-4df0-968b-deaaf4f7dcc4 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb42a03c430>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:17.946704 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-709d3cc7-1e83-48a2-b91e-017738d6ea5a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 20991 microversion: 2.1 time: 0.122171 Nov 19 13:37:17.947679 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 113/225] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:17 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 20991 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:17.974946 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-78fa8411-1c5f-4df0-968b-deaaf4f7dcc4 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/ae99b788-eb35-4f89-b394-cb0fbd948559" status: 200 len: 349 microversion: 2.1 time: 0.067786 Nov 19 13:37:17.976067 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 113/226] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:37:17 2021] GET /compute/v2.1/os-volumes/ae99b788-eb35-4f89-b394-cb0fbd948559 => generated 349 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:17.988909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-97f28ff4-4b18-4b83-b657-9154e560b158 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb42a782550>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.084446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-97f28ff4-4b18-4b83-b657-9154e560b158 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.100342 Nov 19 13:37:18.085065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 114/227] 10.222.0.74 () {58 vars in 1133 bytes} [Fri Nov 19 13:37:17 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:18.097253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-de95885f-9541-46d3-90ab-00198f8bd2eb tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb429f8cc10>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.188042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-de95885f-9541-46d3-90ab-00198f8bd2eb tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094421 Nov 19 13:37:18.188805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 114/228] 10.222.0.74 () {58 vars in 1148 bytes} [Fri Nov 19 13:37:18 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:18.202954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-afc97fcd-faae-4fb1-ac98-b7130e647a9a tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb42a70f9d0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.286606 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.287437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:18.289424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-afc97fcd-faae-4fb1-ac98-b7130e647a9a tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090539 Nov 19 13:37:18.290035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 115/229] 10.222.0.74 () {58 vars in 1133 bytes} [Fri Nov 19 13:37:18 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:18.295168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.295885 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:18.300570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:18.301094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:18.302110 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:18.302616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:18.303180 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:18.303695 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:18.304655 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:18.305362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:18.815873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:18.822037 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:18.823459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-322dd939-8759-4302-8851-d0c0551f97aa tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.540550 Nov 19 13:37:18.833735 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 115/230] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:18 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:18.834062 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b6b32e7f-847d-4158-b376-fe4c238c83c0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.538775 Nov 19 13:37:18.834479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fab3e2d9-f0d7-493b-b0ec-0ac94391ed07 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb429f8cd30>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.834566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 116/231] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:18 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:18.869909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:18.871198 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:18.877168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:18.877608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:18.878561 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:18.879178 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:18.925903 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fab3e2d9-f0d7-493b-b0ec-0ac94391ed07 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100590 Nov 19 13:37:18.926469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 116/232] 10.222.0.74 () {58 vars in 1166 bytes} [Fri Nov 19 13:37:18 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:18.939078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e4010b13-d447-44fa-9447-741c86d4200d tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb429eec8b0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:18.989395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-062c74bc-d2e7-4189-8fe1-2328e9840d09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 17744 microversion: 2.20 time: 0.123283 Nov 19 13:37:18.990294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 117/233] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:18 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 17744 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:18.999959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:19.000241 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:19.009422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:19.010211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:19.012956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:19.013512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:19.022420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e4010b13-d447-44fa-9447-741c86d4200d tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087075 Nov 19 13:37:19.028962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 117/234] 10.222.0.74 () {58 vars in 1169 bytes} [Fri Nov 19 13:37:18 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:37:19.045689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-db9a6a9b-c3cc-431d-a672-6dcf07600481 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb429efce50>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:19.136550 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-17574639-b56d-4833-bb77-e3e9e01263c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 22064 microversion: 2.1 time: 0.140396 Nov 19 13:37:19.137652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 118/235] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:18 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 22064 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:19.160506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-db9a6a9b-c3cc-431d-a672-6dcf07600481 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.127478 Nov 19 13:37:19.161093 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 118/236] 10.222.0.74 () {58 vars in 1154 bytes} [Fri Nov 19 13:37:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:19.175787 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7e578757-b6e3-40bf-a373-2a260bc97040 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb42a791820>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:19.291960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7e578757-b6e3-40bf-a373-2a260bc97040 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.121630 Nov 19 13:37:19.292996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 119/237] 10.222.0.74 () {58 vars in 1187 bytes} [Fri Nov 19 13:37:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:19.312171 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-464e9098-20dd-47f0-b8f5-6b8e22c2d221 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] Calling method '.version_select at 0x7fb42a8c6550>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:19.398425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-464e9098-20dd-47f0-b8f5-6b8e22c2d221 tempest-VolumesTestJSON-458057539 tempest-VolumesTestJSON-458057539-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094926 Nov 19 13:37:19.399435 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 119/238] 10.222.0.74 () {58 vars in 1154 bytes} [Fri Nov 19 13:37:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:19.843647 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:19.844432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:19.847128 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:19.847861 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:19.851086 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:19.851565 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:19.852544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:19.853160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:19.854497 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:19.854951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:19.856285 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:19.857017 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:20.078807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:20.087160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-10857e30-e375-4e7b-a7a8-5232df68a872 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.248469 Nov 19 13:37:20.087315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:20.096926 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-195e8022-5f46-4a13-b575-8c8a5c247371 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.253377 Nov 19 13:37:20.102803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 120/239] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:19 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:20.103040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 120/240] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:19 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:20.103245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:20.103764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:20.109865 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:20.110327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:20.111140 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:20.111582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:20.149205 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:20.150401 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:20.156969 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:20.157416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:20.158217 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:20.158648 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:20.206223 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-302dff55-85d8-4387-bcb9-50c1439be904 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 19342 microversion: 2.20 time: 0.107018 Nov 19 13:37:20.206761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 121/241] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:20 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 19342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:20.259232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d36b491c-9d54-47fa-8d8e-0fa16b1eeb3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 23217 microversion: 2.1 time: 0.113830 Nov 19 13:37:20.261038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 121/242] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:20 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 23217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:37:20.711388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-f91e8f4f-0389-4a2c-b0fa-32d1007ad163 req-7c1def15-f23c-4742-8e7a-e6de466184ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc664a9-a9d4-4827-9bb5-94c81531a0e5", "name": "network-vif-plugged", "status": "completed", "tag": "b5edbcfa-b003-4f23-9e31-e4f781f893f8"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:20.713388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:37:20.713388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:37:20.725127 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-f91e8f4f-0389-4a2c-b0fa-32d1007ad163 req-7c1def15-f23c-4742-8e7a-e6de466184ce service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:20.725571 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-f91e8f4f-0389-4a2c-b0fa-32d1007ad163 req-7c1def15-f23c-4742-8e7a-e6de466184ce service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:20.737913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-f91e8f4f-0389-4a2c-b0fa-32d1007ad163 req-7c1def15-f23c-4742-8e7a-e6de466184ce service nova] Creating event network-vif-plugged:b5edbcfa-b003-4f23-9e31-e4f781f893f8 for instance 9dc664a9-a9d4-4827-9bb5-94c81531a0e5 on hv-cinder-81735 Nov 19 13:37:20.743034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-f91e8f4f-0389-4a2c-b0fa-32d1007ad163 req-7c1def15-f23c-4742-8e7a-e6de466184ce service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042430 Nov 19 13:37:20.743685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 122/243] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:37:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:21.105419 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:21.106560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:21.114069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.114506 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.114974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:21.115477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.115735 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:21.115887 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.122303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.122757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.123579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.124012 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.324745 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:21.329739 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:21.333551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ad6079e8-3787-45da-955a-1feb02e462ef tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.232299 Nov 19 13:37:21.334142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 122/244] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:21 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:21.339158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:21.340309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:21.341515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-346ca541-2554-4846-8b10-8a6d0c3a0838 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.231201 Nov 19 13:37:21.344372 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 123/245] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:21 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:21.347679 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.348286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.348853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:21.349544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.349922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:21.350141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.356686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.357336 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.358255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:21.358816 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:21.467668 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a6533178-3944-4634-8876-e7762573f8b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 23878 microversion: 2.1 time: 0.121951 Nov 19 13:37:21.468328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 124/246] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:21 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 23878 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:21.484472 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ff3c3148-5f0c-4812-820f-1f05b86dc941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 21338 microversion: 2.20 time: 0.149027 Nov 19 13:37:21.485227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 123/247] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:21 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 21338 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:22.355015 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:22.355717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:22.362532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:22.364039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:22.364198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.364585 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.365446 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.365991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.372384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.373171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.374035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.375957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.591446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:22.599193 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:22.599671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1e6505a8-ee9b-4d6a-ba16-307cc690aae1 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.241477 Nov 19 13:37:22.603184 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 124/248] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:22 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:22.606509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:22.607375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:22.608207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f0098be7-fedd-4e13-9880-d3eab258a989 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1317 microversion: 2.1 time: 0.258897 Nov 19 13:37:22.617696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 125/249] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:22 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:22.617696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:22.617696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:22.618053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.618053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.618053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.618053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.622469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.622933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.623759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:22.624194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:22.743734 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5a89325b-2229-4b88-ada8-4e529410c0fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 22757 microversion: 2.20 time: 0.133121 Nov 19 13:37:22.744833 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 126/250] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:22 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 22757 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:22.764835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d88dcf2e-da30-4580-b786-f8e17e9fdc63 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 24759 microversion: 2.1 time: 0.162455 Nov 19 13:37:22.765649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 125/251] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:22 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 24759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:23.621483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:23.622941 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:23.626724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:23.628572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:23.632253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.632941 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.633986 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.634715 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.646454 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.647281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.648386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.649064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.858680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:23.862295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:23.866639 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-018f7240-3731-403a-aeab-194453c3a03e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.252477 Nov 19 13:37:23.867447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 127/252] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:23 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:23.870800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-85c35b1c-5c14-413f-b298-dd16fd671fae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1506 microversion: 2.1 time: 0.249055 Nov 19 13:37:23.871421 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 126/253] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:23 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:23.876195 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:23.877369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:23.883298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:23.884456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.885161 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.886359 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.887059 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.887508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:23.896343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.896929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:23.897944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:23.898487 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.001753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0b18ce7d-8f2d-4087-8bfa-b3d4b95fed05 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 25693 microversion: 2.1 time: 0.128815 Nov 19 13:37:24.005847 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 127/254] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:23 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 25693 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:24.007827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a92564-cc3e-4b8b-9f4e-bbd42e7bf222"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:24.008957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:24.016351 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.016787 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.017559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.018026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.019414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a6b94ca3-14b1-4306-909c-fb6a93fc5f54 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 23793 microversion: 2.20 time: 0.141509 Nov 19 13:37:24.020162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 128/255] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:23 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 23793 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:24.108476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] HTTP exception thrown: Invalid volume: volume c7a92564-cc3e-4b8b-9f4e-bbd42e7bf222 is already attached to instances: df0e9fcb-022c-4369-8d5e-b644024f55aa Nov 19 13:37:24.109246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Returning 400 to user: Invalid volume: volume c7a92564-cc3e-4b8b-9f4e-bbd42e7bf222 is already attached to instances: df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:37:24.110112 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-eb91f852-5b38-4773-98bd-e086c8c8943c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106334 Nov 19 13:37:24.110921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 128/256] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:37:24 2021] POST /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 13:37:24.170843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:24.171442 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:24.178604 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.179052 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.179867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.180299 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.317406 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'services' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:37:24.442732 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e02c5e79-6642-4a4c-965c-e28e331817e2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments/c7a92564-cc3e-4b8b-9f4e-bbd42e7bf222" status: 202 len: 0 microversion: 2.1 time: 0.276144 Nov 19 13:37:24.443388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 129/257] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:37:24 2021] DELETE /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments/c7a92564-cc3e-4b8b-9f4e-bbd42e7bf222 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:24.453464 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:24.454748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:24.461395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.461715 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.462468 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.463001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.499860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6ea52fd1-53ca-4643-a1f8-89bb0c3cbb2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051551 Nov 19 13:37:24.501187 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 129/258] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:37:24 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:24.885087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:24.885785 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:24.891991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.892432 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:24.893237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:24.893659 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.014446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:25.018540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:25.025623 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:25.026201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.027022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:25.027562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.041270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:25.050170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-77d818b9-98d3-413c-8083-111a4ea9427d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.169810 Nov 19 13:37:25.051526 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 130/259] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:24 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:25.059165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:25.060673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:25.068640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:25.069093 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.069930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:25.070584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.196763 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-84c85cef-5e31-4cfd-a14c-41e43665fba2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 26278 microversion: 2.1 time: 0.186446 Nov 19 13:37:25.197566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 130/260] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:25 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 26278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:25.217856 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ff886e70-6bc6-4c0a-95d0-52c90db1e0bb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 24459 microversion: 2.20 time: 0.164825 Nov 19 13:37:25.218501 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 131/261] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:25 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 24459 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:25.513594 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:25.514950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:25.525283 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:25.526189 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.528302 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:25.529586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:25.568668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c2c5ccc8-a47f-4ec4-a838-2fa88872c9cc tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060515 Nov 19 13:37:25.569314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 131/262] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:37:25 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:26.071689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:26.073153 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:26.083747 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.084208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.085399 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.086049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.210263 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:26.211494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:26.219120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.219606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.220426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.220855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.250208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:26.258080 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5cff5bca-6af4-4426-a766-0ed674f124fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.193217 Nov 19 13:37:26.258663 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 132/263] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:26 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:26.263207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:26.264122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:26.269748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.270194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.270965 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.271418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.327694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-86c5e2b4-6477-46cd-af4b-41581dbcd683 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 26950 microversion: 2.1 time: 0.122217 Nov 19 13:37:26.328240 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 132/264] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:26 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 26950 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:26.375991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-aa600b3e-c401-45d1-9f23-634cdbd6b8d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 25340 microversion: 2.20 time: 0.116019 Nov 19 13:37:26.376652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 133/265] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:26 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 25340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:26.581309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:26.582296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:26.589332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.589770 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.590554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:26.590997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:26.624932 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-999c1ffa-fadb-4135-8b5e-1bdc41e03959 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047514 Nov 19 13:37:26.625479 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 133/266] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:37:26 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:37:26.814495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-186182902", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "d4b5f30c-9859-4dc0-9964-fe81b0775d18"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:27.277036 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:27.277600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:27.285801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:27.286446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:27.287728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:27.288413 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:27.432725 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:27.441004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-83fe771c-6da5-4cbe-9c97-69834feb1b76 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.168949 Nov 19 13:37:27.441601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 134/267] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:27 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:27.446123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:27.447059 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:27.454284 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:27.454737 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:27.455545 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:27.455976 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:27.546942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0392683c-8ec4-4396-93af-9e8e4cef1b2a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 27432 microversion: 2.1 time: 0.103909 Nov 19 13:37:27.547610 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 135/268] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:27 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 27432 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:27.553255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:27.554369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:27.563331 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:27.563843 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:27.564646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:27.565075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:27.654426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3d4dd235-28a1-4510-90b4-4c1dd841e345 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 26117 microversion: 2.20 time: 0.105112 Nov 19 13:37:27.655048 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 136/269] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:27 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 26117 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:28.460243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:28.460919 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:28.468625 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:28.469069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:28.469865 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:28.470293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:28.613171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:28.620821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-481c4333-8cf5-4cca-b82e-3447d9842384 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.164811 Nov 19 13:37:28.621395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 137/270] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:28 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:28.625819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:28.626730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:28.632866 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:28.633310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:28.634321 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:28.634634 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:29.876578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] validate_networks() for [('d4b5f30c-9859-4dc0-9964-fe81b0775d18', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:37:30.284571 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:37:30.284962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:37:30.285482 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:37:30.285888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:37:30.286301 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:37:30.295541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:30.295892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:30.296788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:30.297133 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:30.314742 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:37:30.319265 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for user 94c7c0bfd6f84b29b28fec4fcef50f41 and project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:37:30.330615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:37:30.333263 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:37:30.381510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-35ed03dd-e344-419f-9b43-1dcbb1e8b7ff tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.571307 Nov 19 13:37:30.386938 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 134/271] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:37:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 3573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:37:30.386938 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:30.387810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:30.394618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:30.395062 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:30.395872 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:30.396289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:31.899227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-771487c3-f21e-48d3-8211-07fa06297ec3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 27671 microversion: 2.1 time: 3.276580 Nov 19 13:37:31.899874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 138/272] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:28 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 27671 bytes in 3278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:31.905242 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:31.905921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:31.913365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:31.913815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:31.914596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:31.915018 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:31.920478 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f1d59887-04d2-4e6a-88ee-4bae074f7f48 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 27615 microversion: 2.20 time: 1.537089 Nov 19 13:37:31.925909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 135/273] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:30 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 27615 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:31.926835 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:31.927654 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:31.937364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:31.938099 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:31.939147 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:31.939770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:32.032086 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:32.039605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8dca6b67-c5ee-4c29-ac12-bb5d9313da4a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1221 microversion: 2.1 time: 0.116917 Nov 19 13:37:32.040185 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 136/274] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:31 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:32.100266 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:32.109671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1cab5d63-74d3-4887-a377-be395f480c13 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.208169 Nov 19 13:37:32.110420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 139/275] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:31 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:32.912417 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:32.913580 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:32.922504 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:32.925743 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:32.927569 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:32.933928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:32.936225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:32.941900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:32.951950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:32.952407 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:32.953323 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:32.953774 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:33.066727 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c0e506f8-51b0-48dc-82be-04f141271686 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28145 microversion: 2.1 time: 0.158667 Nov 19 13:37:33.067750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 137/276] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:32 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28145 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:33.075086 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:33.075904 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:33.083424 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:33.083888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:33.084700 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:33.085137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:33.101066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e6b45172-4fce-4c43-be28-c514913f86bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 27938 microversion: 2.20 time: 0.171298 Nov 19 13:37:33.101752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 140/277] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:32 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 27938 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:33.128733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:33.130000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:33.137288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:33.137733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:33.138514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:33.138941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:33.150307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:33.158990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-40836ff0-9329-4513-8edb-7819c4f70ba7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1275 microversion: 2.1 time: 0.089608 Nov 19 13:37:33.159623 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 138/278] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:33 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:33.276843 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:33.286544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4811475e-6eb6-48b8-94ce-d02c7adb540a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.162663 Nov 19 13:37:33.296906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 141/279] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:33 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:33.970543 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-e4c9f227-dc02-44d2-a5f5-b3ae41ec60c9 req-758f552e-12ef-4422-82b5-8b458aeab29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956eae6f-3a6a-4db9-97f6-d6b89d4727ac", "tag": "4ecd3cb2-7e39-4c27-babb-37b69833287a"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:33.972934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:37:33.972934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:37:33.982264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-e4c9f227-dc02-44d2-a5f5-b3ae41ec60c9 req-758f552e-12ef-4422-82b5-8b458aeab29a service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:33.982780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-e4c9f227-dc02-44d2-a5f5-b3ae41ec60c9 req-758f552e-12ef-4422-82b5-8b458aeab29a service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.000476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-e4c9f227-dc02-44d2-a5f5-b3ae41ec60c9 req-758f552e-12ef-4422-82b5-8b458aeab29a service nova] Creating event network-changed:4ecd3cb2-7e39-4c27-babb-37b69833287a for instance 956eae6f-3a6a-4db9-97f6-d6b89d4727ac on hv-cinder-81735 Nov 19 13:37:34.007052 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-e4c9f227-dc02-44d2-a5f5-b3ae41ec60c9 req-758f552e-12ef-4422-82b5-8b458aeab29a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040099 Nov 19 13:37:34.007788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 139/280] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:37:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:34.081164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:34.082195 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:34.088898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.089349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.090163 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.090579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.117761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:34.119125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:34.126906 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.127684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.128561 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.129191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.159642 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6decac67-00cd-4593-81e2-7eb4b7d77941 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28145 microversion: 2.1 time: 0.082003 Nov 19 13:37:34.160465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 142/281] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:34 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:37:34.177426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:34.178117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:34.185077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.185527 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.186750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.187083 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.223903 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6b31a926-19b2-4309-aa87-7253d211401f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28119 microversion: 2.20 time: 0.111097 Nov 19 13:37:34.224684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 140/282] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:34 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28119 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:34.304604 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:34.305354 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:34.316009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.316973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.318767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:34.319565 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:34.341126 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:34.348743 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6abfdf94-9479-4c22-a9b0-5ff3125ffd94 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.175356 Nov 19 13:37:34.349968 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 143/283] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:34 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:34.476206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:34.483937 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-33abd3b9-e7d1-477f-8026-9399ca3c768f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.183591 Nov 19 13:37:34.484507 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 141/284] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:34 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:35.171405 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:35.172373 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:35.179595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.180052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.180836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.181271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.237372 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:35.238383 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:35.245867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.246321 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.247128 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.247600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.317838 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-08321e14-0294-453b-9a19-89737d19fb4c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28145 microversion: 2.1 time: 0.150104 Nov 19 13:37:35.318483 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 144/285] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:35 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28145 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:35.347246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-efc135e6-430d-4f92-9903-30055216c699 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28119 microversion: 2.20 time: 0.113520 Nov 19 13:37:35.347916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 142/286] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:35 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28119 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:35.368827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:35.369517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:35.376914 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.377369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.378164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.378597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.502481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:35.503377 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:35.511675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.512118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.513196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:35.513622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:35.532159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:35.541866 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-149e5cdb-1691-48d6-bdde-e2b767ed227e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.178859 Nov 19 13:37:35.543073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 145/287] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:35 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:35.666917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:35.676080 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c501fce6-3132-4639-84f9-c793614a9ccd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.177744 Nov 19 13:37:35.676700 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 143/288] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:35 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:36.331120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:36.332035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:36.339330 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.339754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.340583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.341021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.361661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:36.362991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:36.372116 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.372530 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.373552 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.374006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.432831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f954f378-f579-4577-8f84-a77444ab7ef3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28339 microversion: 2.1 time: 0.105231 Nov 19 13:37:36.433488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 146/289] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:36 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:36.448161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-902fbfd7-af70-4c8a-a689-65d14f7375ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28119 microversion: 2.20 time: 0.090015 Nov 19 13:37:36.448795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 144/290] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:36 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28119 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:36.564553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:36.565606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:36.574668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.575124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.575921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.576352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.694084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:36.694888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:36.703179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.703649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.704675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:36.705088 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:36.733170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:36.745249 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-db651282-9687-4f38-af76-d88254764809 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.187420 Nov 19 13:37:36.746085 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 147/291] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:36 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:36.850462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:36.858355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c501950f-42bc-4d38-816a-207fec817419 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.168416 Nov 19 13:37:36.858948 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 145/292] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:36 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:37.445424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:37.446344 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:37.453123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.453566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.454337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.454802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.460061 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:37.461154 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:37.469130 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.469587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.470479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.471217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.557867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-24b14e95-5b86-47d0-b3f1-e38e0d6186e3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28435 microversion: 2.1 time: 0.116022 Nov 19 13:37:37.558694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 148/293] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:37 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28435 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:37.562158 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e65e880e-d35e-46e7-be6a-92a6dab35058 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28119 microversion: 2.20 time: 0.105330 Nov 19 13:37:37.562808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 146/294] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:37 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28119 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:37.765696 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:37.766416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:37.776047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.776491 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.777294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.777731 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.876749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:37.877423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:37.885225 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.885664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.886456 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:37.886900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:37.923422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:37.931158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c9b787ad-4aba-429b-8ea6-7b48ea4a2768 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.171237 Nov 19 13:37:37.931795 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 149/295] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:37 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:38.031821 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:38.044361 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-00dad92f-b802-46cd-ab13-fffa59212eb5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.171623 Nov 19 13:37:38.045159 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 147/296] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:37 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:38.570569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:38.572862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:38.575369 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:38.576886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:38.579965 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:38.580422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:38.581220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:38.581658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:38.583773 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:38.584499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:38.585842 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:38.587390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:38.695898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7dcbc678-2603-479f-a4ec-a1c71de75c8a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28435 microversion: 2.1 time: 0.128176 Nov 19 13:37:38.700990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 150/297] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:38 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28435 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:38.737276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f2a9effb-22f1-4be8-a6b7-493d1a1d4e25 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28409 microversion: 2.20 time: 0.167059 Nov 19 13:37:38.738126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 148/298] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:38 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:38.950876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:38.951717 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:38.959555 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:38.960004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:38.960798 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:38.961230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.062549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:39.063278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:39.070670 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:39.071148 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.071952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:39.072383 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.111142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:39.121898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-263404ea-155e-43ba-a46e-d07444d5cecf tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.176565 Nov 19 13:37:39.122474 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 151/299] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:38 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:39.230750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:39.238861 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-98da2fc6-d213-4867-999c-298487d1832f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.180567 Nov 19 13:37:39.239654 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 149/300] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:39 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:39.709545 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:39.711426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:39.718925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:39.719412 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.720408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:39.720928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.750203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:39.751270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:39.758393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:39.758888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.760022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:39.760666 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:39.813519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e0433b40-0f5b-4756-bfbc-b5d1a5617717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 0.107745 Nov 19 13:37:39.814514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 152/301] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:39 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:39.855218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b1dc4812-61fa-43ce-8a93-182feedad899 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28409 microversion: 2.20 time: 0.109520 Nov 19 13:37:39.855885 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 150/302] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:39 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28409 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:40.144909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:40.145670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:40.156481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.157144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.158287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.159023 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.256848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:40.257587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:40.265366 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.265813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.266608 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.267044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.303123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:40.312206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-23d314fa-f6d2-457e-abfd-972c9ad1226f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.174203 Nov 19 13:37:40.316722 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 153/303] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:40 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:40.413378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:40.422184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-46dcb627-26ab-4bd2-bb9c-a48f481ccc69 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.169370 Nov 19 13:37:40.422764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 151/304] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:40 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:40.750732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-4b3bf83c-7d45-4457-8e28-3b1aee69b88f req-57492a24-eda1-43b7-ac80-36df329173f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956eae6f-3a6a-4db9-97f6-d6b89d4727ac", "name": "network-vif-plugged", "status": "completed", "tag": "4ecd3cb2-7e39-4c27-babb-37b69833287a"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:40.752535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:37:40.752535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:37:40.772724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-4b3bf83c-7d45-4457-8e28-3b1aee69b88f req-57492a24-eda1-43b7-ac80-36df329173f7 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.774000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-4b3bf83c-7d45-4457-8e28-3b1aee69b88f req-57492a24-eda1-43b7-ac80-36df329173f7 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.793138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-4b3bf83c-7d45-4457-8e28-3b1aee69b88f req-57492a24-eda1-43b7-ac80-36df329173f7 service nova] Creating event network-vif-plugged:4ecd3cb2-7e39-4c27-babb-37b69833287a for instance 956eae6f-3a6a-4db9-97f6-d6b89d4727ac on hv-cinder-81735 Nov 19 13:37:40.798486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-4b3bf83c-7d45-4457-8e28-3b1aee69b88f req-57492a24-eda1-43b7-ac80-36df329173f7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052516 Nov 19 13:37:40.799745 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 154/305] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:37:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:40.830737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:40.832695 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:40.841364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.841827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.842644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.843066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.867702 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:40.869146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:40.878035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.878932 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.880073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:40.880674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:40.929607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-032ca506-6d89-42f0-9502-c91701db31ca tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 0.105624 Nov 19 13:37:40.930270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 152/306] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:40 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:40.984990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e3e260ec-9f25-42a8-90af-15f448df1710 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.121200 Nov 19 13:37:40.986094 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 155/307] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:40 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:41.330337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:41.331015 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:41.338305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:41.338758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:41.339735 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:41.340250 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:41.441026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:41.441649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:41.450500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:41.451084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:41.452024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:41.452443 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:41.512311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:41.520389 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7a70be18-5ead-49e7-bffd-478771faefd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.194717 Nov 19 13:37:41.520961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 153/308] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:41 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:41.604936 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:41.615132 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-61895237-8bfd-4dee-a6c5-3f5260e9bcc5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.179269 Nov 19 13:37:41.615748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 156/309] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:41 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:37:41.987398 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:41.989297 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:42.016915 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.018140 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.019828 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.021230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.045225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:42.047482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:42.055926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.056620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.057840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.058653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.130663 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5ff96875-a39a-4312-b064-87c0e6c5372e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 0.148964 Nov 19 13:37:42.135076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 154/310] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:41 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:42.164906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9af29084-9aca-41c7-9f9a-b5fa1f4077cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.124039 Nov 19 13:37:42.165579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 157/311] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:42 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:42.538950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:42.539684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:42.549506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.550012 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.551088 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.551734 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.634748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:42.635759 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:42.643360 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.643814 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.644605 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:42.645034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:42.737485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:42.745345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-825f1a9b-929a-4b29-9e5c-a71f050be937 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.210616 Nov 19 13:37:42.746095 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 155/312] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:42 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:42.804095 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:42.812574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3bade938-8010-454d-831c-397567575e1c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.182397 Nov 19 13:37:42.813158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 158/313] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:42 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:43.145480 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:43.146678 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:43.156170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:43.156764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:43.157836 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:43.158388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:43.176501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:43.177487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:43.184944 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:43.185396 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:43.186543 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:43.187015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:45.478235 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a25f528f-79a7-4f51-bb66-3da49b413468 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 2.304996 Nov 19 13:37:45.479136 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 159/314] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:43 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:45.484465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:45.485148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:45.492380 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:45.492834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:45.493626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:45.494036 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:45.497243 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-61dd52a2-e631-4da7-ae2a-b2dc7f8dd569 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 2.356492 Nov 19 13:37:45.502293 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 156/315] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:43 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:45.504512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:45.505291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:45.512569 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:45.513105 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:45.513908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:45.514312 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:45.711004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:45.724160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-90241805-a5a9-46d6-9c88-f11c954a5d2c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1317 microversion: 2.1 time: 0.243440 Nov 19 13:37:45.725430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 160/316] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:45 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:45.734211 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:45.745101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-946e19a6-56d8-473f-91f2-6d07430e5c4c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.244888 Nov 19 13:37:45.745831 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 157/317] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:45 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:46.490451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:46.491346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:46.498858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.499348 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.500146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.500583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.509794 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:46.510911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:46.517893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.518325 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.519148 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.519821 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.604757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-505140dc-6010-42aa-b0c4-0922d0ffd723 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 0.098176 Nov 19 13:37:46.605557 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 158/318] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:46 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:46.611514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-140f9313-26fe-4255-a16f-1a2bea0c932b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.124630 Nov 19 13:37:46.612340 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 161/319] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:46 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:46.743889 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:46.744934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:46.753684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.754134 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.754930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.755399 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.762188 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:46.763152 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:46.770302 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.770751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.771572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:46.772001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:46.981268 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:46.991802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6e9b0dfc-386a-4784-bcf5-451a00f39437 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.233538 Nov 19 13:37:46.992643 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 162/320] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:46 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:47.001022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:47.009207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-85e373a5-e0b9-4566-b78b-41c7e6595cc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1506 microversion: 2.1 time: 0.269758 Nov 19 13:37:47.009918 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 159/321] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:46 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:47.618156 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:47.619055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:47.623500 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:47.624531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:47.625865 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:47.626269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:47.627040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:47.627971 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:47.630743 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:47.631234 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:47.632020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:47.632451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:50.678154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b5db88d6-6e5d-43c6-9b18-5176a3c9e226 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 3.063539 Nov 19 13:37:50.678857 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 163/322] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:47 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 3065 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:50.683989 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-99a256f0-f5c0-4e99-8bcc-7b5688ec47df tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 3.064111 Nov 19 13:37:50.684525 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:50.685309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:50.686766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 160/323] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:47 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 3068 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:50.693326 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:50.693785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:50.694562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:50.694982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:50.831892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:50.839583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8b412fb7-dfe7-467a-94ce-bc1af1699227 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.159452 Nov 19 13:37:50.840160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 164/324] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:50 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:51.551541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14621bed-c9aa-497e-ab9a-db7c4d603485"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:51.552630 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:51.560019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:51.560614 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:51.561769 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:51.562205 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:51.690358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:51.693025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:51.698047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:51.698500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:51.699325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:51.699893 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:54.464404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0024806e-21f6-448e-88b1-41d28e774a31 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 2.777723 Nov 19 13:37:54.466243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 165/325] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:51 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:54.472644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:54.474076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:54.481318 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:54.481757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:54.482936 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:54.483654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:54.584518 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9e6b9406-0efa-4a20-9e76-0fd0b09ef02f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.037275 Nov 19 13:37:54.585337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 161/326] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:37:51 2021] POST /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments => generated 194 bytes in 3039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:37:54.590192 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:54.590977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:54.598331 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:54.598331 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:54.599834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:54.599834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:54.626476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a9efe6c4-181f-4899-89de-8dd14f3e129b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.158189 Nov 19 13:37:54.631424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 166/327] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:54 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:54.740700 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:54.750922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9f0984bf-3dd5-44c4-a5aa-1c221ffbcee9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1521 microversion: 2.1 time: 0.164428 Nov 19 13:37:54.751537 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 162/328] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:54 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:55.478465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:55.480039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:55.487306 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.487760 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.488520 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.488941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.571756 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-46907b06-ebba-42fe-90bc-fd7ec9e0f3ce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 0.096618 Nov 19 13:37:55.572846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 167/329] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:55 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:55.640459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:55.641544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:55.650316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.650763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.651773 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.652523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.744415 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1b7fe259-ea9e-47b7-a383-8bb3d72e737c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.108255 Nov 19 13:37:55.745480 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 163/330] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:55 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:55.769507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:55.770244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:55.777206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.777548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.778456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.778894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.929501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:55.940305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5ca615b6-4cf0-4cfd-96ad-26994dc92a47 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1501 microversion: 2.1 time: 0.174785 Nov 19 13:37:55.941567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 168/331] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:55 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:55.958079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:55.959416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:55.966883 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.967760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:55.968789 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:55.969236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:56.130350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:56.145811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b1658dd4-e070-4179-8681-0c6c028a440a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1515 microversion: 2.1 time: 0.192029 Nov 19 13:37:56.146644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 164/332] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:55 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:56.583855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:56.585204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:56.592148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:56.592663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:56.593381 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:56.593902 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:56.667142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-22944792-db37-4df5-bf56-8091ed05bf1a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28602 microversion: 2.1 time: 0.086969 Nov 19 13:37:56.671741 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 169/333] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:56 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28602 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:56.758813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:56.758813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:56.765688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:56.765688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:56.766593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:56.767728 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:56.858947 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a7b4f7d5-dcf7-4461-92f2-2602ac036280 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.105379 Nov 19 13:37:56.859695 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 165/334] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:56 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:57.533088 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:57.534165 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:57.541087 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.541630 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.542415 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.542847 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.569489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lazy-loading 'flavor' on Instance uuid a4794168-fa1e-43da-a27c-e5e83054dd1e {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:37:57.644925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-78d531a5-9f34-41f1-b6d2-dab14d4edb9e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action" status: 200 len: 32 microversion: 2.1 time: 0.116241 Nov 19 13:37:57.645566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 170/335] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:57 2021] POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:37:57.655987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:57.656891 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:57.664662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.665126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.665912 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.666348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.680039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:57.681382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:57.689749 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.690540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.691607 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.692291 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.804228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1c118e28-8666-4b9f-8335-0c19f6a1b140 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 28754 microversion: 2.1 time: 0.127447 Nov 19 13:37:57.804888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 171/336] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:57 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 28754 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:57.871462 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:57.872513 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:57.887603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.889075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.892091 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:57.892872 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:57.902235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:57.913845 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cea5aaa4-edc8-4391-bac3-6c7ea101f1b8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.262354 Nov 19 13:37:57.919991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 166/337] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:57 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:58.006415 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6ca47944-a3d3-4b51-ab63-3cb36eed032e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28576 microversion: 2.20 time: 0.139476 Nov 19 13:37:58.007624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 172/338] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:57 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:37:58.817871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:58.818882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:58.826603 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:58.827053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:58.827916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:58.828562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:58.933757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2ff95921-4245-4c24-b029-1552841f9aed tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 29900 microversion: 2.1 time: 0.120013 Nov 19 13:37:58.935690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 167/339] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:58 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 29900 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:37:58.937780 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:37:58.938608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:58.945495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:58.945915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:58.946721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:58.947139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:59.022298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:59.023384 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:59.030556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:59.031066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:59.031896 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:59.032322 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:59.104420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:37:59.112728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9f4bc2b3-56bf-43ca-afca-ee3e1212a4ba tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.180058 Nov 19 13:37:59.113324 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 173/340] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:37:58 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:37:59.134241 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7540cfda-80a8-4675-a30a-ca9e93b24070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 28910 microversion: 2.20 time: 0.116710 Nov 19 13:37:59.138550 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 168/341] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:37:59 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 28910 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:37:59.946526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:37:59.948235 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:37:59.954858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:59.955530 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:37:59.957319 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:37:59.957319 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:00.038386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1bd5e8ce-9abe-498f-9cbb-5b34a37aefff tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 30915 microversion: 2.1 time: 0.095361 Nov 19 13:38:00.039143 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 174/342] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:37:59 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 30915 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:38:00.130565 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:00.131270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:00.138850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:00.139344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:00.140149 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:00.140714 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:00.149575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:00.151045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:00.161751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:00.162760 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:00.164170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:00.164918 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:00.277316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-43b5e04a-50c2-4c6b-a4cb-d2b6c0d1664f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 29957 microversion: 2.20 time: 0.133691 Nov 19 13:38:00.279310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 175/343] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:00 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 29957 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:00.304245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:00.312646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6c80ab52-a4cb-48df-824d-431e4027a9d8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.186291 Nov 19 13:38:00.313333 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 169/344] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:00 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:01.052629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:01.053661 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:01.067405 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:01.076550 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:01.077539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:01.077994 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:01.186139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7d1ec316-a625-4bd2-b3ca-0f4940ade41c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 31863 microversion: 2.1 time: 0.134917 Nov 19 13:38:01.186911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 176/345] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:01 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 31863 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:01.292827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:01.294077 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:01.301006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:01.301471 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:01.302298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:01.302990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:01.333223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:01.342350 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:01.347894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:01.348533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:01.349460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:01.350854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:01.419346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3fba1989-51d2-48c8-bd8e-793fb05255c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 30829 microversion: 2.20 time: 0.130871 Nov 19 13:38:01.420632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 170/346] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:01 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 30829 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:01.570724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:01.579792 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0fbf59ba-19ed-4810-ba53-a4d89deb3707 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.253025 Nov 19 13:38:01.592940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 177/347] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:01 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:02.161429 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14621bed-c9aa-497e-ab9a-db7c4d603485"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:02.162568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:02.169620 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.170094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.170881 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.171355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.199821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:02.200935 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:02.207766 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.208208 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.209010 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.209426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.278774 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] HTTP exception thrown: Invalid volume: volume 14621bed-c9aa-497e-ab9a-db7c4d603485 is already attached to instances: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac Nov 19 13:38:02.279762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Returning 400 to user: Invalid volume: volume 14621bed-c9aa-497e-ab9a-db7c4d603485 is already attached to instances: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:38:02.280601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-da9d50b5-cb38-4912-9c0a-5c711843c536 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123534 Nov 19 13:38:02.281409 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 171/348] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:38:02 2021] POST /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 13:38:02.304171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c943181d-ceb2-4ae1-9065-0310913997c5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 32642 microversion: 2.1 time: 0.107620 Nov 19 13:38:02.305754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 178/349] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:02 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 32642 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:38:02.350670 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:02.352069 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:02.359566 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.360120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.361275 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.361822 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.438403 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:02.440423 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:02.445589 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'services' on Instance uuid 956eae6f-3a6a-4db9-97f6-d6b89d4727ac {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:38:02.452417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.453200 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.454599 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.455462 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.524407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6067e1ba-72dd-46be-a254-0d7f659cc4d9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments/14621bed-c9aa-497e-ab9a-db7c4d603485" status: 202 len: 0 microversion: 2.1 time: 0.179556 Nov 19 13:38:02.525017 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 172/350] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:38:02 2021] DELETE /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments/14621bed-c9aa-497e-ab9a-db7c4d603485 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:38:02.534317 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:02.535379 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:02.541683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.542150 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.542993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.543620 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.550020 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-96013254-cb85-4d91-a9dd-e8bcba1adb42 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 31897 microversion: 2.20 time: 0.120097 Nov 19 13:38:02.550956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 179/351] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:02 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 31897 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:02.584364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6af0ae79-9e7f-4e05-86e5-77477d3e7bd0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054061 Nov 19 13:38:02.584845 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 173/352] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:02 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:02.599742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:02.600500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:02.608051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.608495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.609647 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:02.610225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:02.761427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:02.769791 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-410356c8-c7fa-4139-9508-8919075eca88 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.174421 Nov 19 13:38:02.770547 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 180/353] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:02 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:03.039591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1357276788", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "a62e8e54-023d-4eec-b3f2-04ffff4d4874"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:03.101008 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] validate_networks() for [('a62e8e54-023d-4eec-b3f2-04ffff4d4874', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:38:03.317244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:03.318269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:03.328548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:03.328989 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:03.329789 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:03.330215 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:03.470095 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:38:03.470656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:38:03.471145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:38:03.471549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:38:03.471949 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:38:03.481939 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:03.482382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:03.483227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:03.483652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:03.503810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Getting quotas for project ff2cb9958b6a458eb2517bc6efab7024. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:38:03.508077 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Getting quotas for user ebdffdb934bc42e9aa6c934625cab499 and project ff2cb9958b6a458eb2517bc6efab7024. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:38:03.519310 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:38:03.522065 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:38:03.578290 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-09330896-f064-42d0-a894-7eed43e263af tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545247 Nov 19 13:38:03.579291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 174/354] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:38:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:38:03.583689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:03.584960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:03.593426 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:03.593897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:03.594693 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:03.595130 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.846958 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-60f0e5ad-48e5-4e6c-a23b-aae413bbd4cb tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 34449 microversion: 2.1 time: 2.533723 Nov 19 13:38:05.847649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 181/355] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:03 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 34449 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:05.852794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:05.853475 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:05.861398 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:05.861715 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.862450 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:05.862902 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.870475 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9d6b26fa-97b2-443d-9cdb-49c84e6573e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 34340 microversion: 2.20 time: 2.289856 Nov 19 13:38:05.871886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 175/356] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:03 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 34340 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:05.877837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:05.879932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:05.886936 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:05.887411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.888421 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:05.888849 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.928986 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-55deef45-44b0-46d6-bc38-178b8589f0b9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055296 Nov 19 13:38:05.929587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 176/357] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:05 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:05.942166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:05.942938 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:05.943895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:05.952408 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:05.953392 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.954320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:05.954797 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:05.960874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-25209510-e24c-4afa-af3e-23c16d4c7de3 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1223 microversion: 2.1 time: 0.110084 Nov 19 13:38:05.961663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 182/358] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:05 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:06.121533 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:06.129424 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-61370798-9f2a-4524-9c66-58e0cab1de56 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.198588 Nov 19 13:38:06.130151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 177/359] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:05 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:06.868358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:06.868358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:06.874908 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:06.876113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:06.877455 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:06.883341 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:06.884289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:06.887963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:06.890802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:06.891294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:06.892277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:06.892863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.017403 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6504b9e0-6dcf-4a70-9670-38e4965583e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 34944 microversion: 2.1 time: 0.160741 Nov 19 13:38:07.019069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 183/360] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:06 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 34944 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:07.025378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:07.026384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:07.033761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.034324 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.035164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.035602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.045296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5f28ebb3-9be0-4596-83f8-2527fbd69d32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 34645 microversion: 2.20 time: 0.165567 Nov 19 13:38:07.046137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 178/361] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:06 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 34645 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:07.058010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:07.059413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:07.070488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c244f2db-dc55-4c0d-b717-0d9f9fe49b61 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049347 Nov 19 13:38:07.071078 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 184/362] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:07 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:38:07.071735 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.072263 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.073091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.073528 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.149590 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:07.150285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:07.158824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.159420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.160270 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.160941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.180725 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:07.190080 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3fb61909-e162-498b-bd4e-35b44afb0179 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1277 microversion: 2.1 time: 0.138725 Nov 19 13:38:07.200694 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 179/363] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:07 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:07.249816 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-753853866", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "d4b5f30c-9859-4dc0-9964-fe81b0775d18"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:07.319807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:07.325785 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] validate_networks() for [('d4b5f30c-9859-4dc0-9964-fe81b0775d18', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:38:07.330153 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2b7344c0-ca9c-4a2f-90f0-b7c3d5caca5f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.184560 Nov 19 13:38:07.342898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 185/364] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:07 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:07.782329 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:38:07.782744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:38:07.783595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:38:07.783595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:38:07.784009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:38:07.792905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.793352 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.794131 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:07.794615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:07.814501 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:38:07.818732 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Getting quotas for user 94c7c0bfd6f84b29b28fec4fcef50f41 and project a2b85b6e9a95402194d48a7909d120a1. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:38:07.831425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:38:07.833803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:38:07.883987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-feb5961d-bb85-4b1a-9f73-03d8168b8187 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638968 Nov 19 13:38:07.889897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 180/365] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:38:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 13:38:07.899584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9b4921f3-6352-41d5-adb7-924fd513d2b7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:07.902800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9b4921f3-6352-41d5-adb7-924fd513d2b7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:07.971083 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9b4921f3-6352-41d5-adb7-924fd513d2b7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:07.983131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9b4921f3-6352-41d5-adb7-924fd513d2b7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1217 microversion: 2.1 time: 0.089746 Nov 19 13:38:07.983131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 186/366] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:07 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:08.039524 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:08.041122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:08.059261 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:08.061483 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:08.081308 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.081934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.082794 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.083278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.085065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.085603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.086452 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.086880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.229734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-54b63f72-2081-4528-9d13-3fe5cea7fbd3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 35327 microversion: 2.20 time: 0.175416 Nov 19 13:38:08.231077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 187/367] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:08 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 35327 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:08.237392 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:08.238251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:08.247741 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.248495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.249499 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.249689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-138b1db7-a47d-4288-b1a8-2fb0b14f24fa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 35560 microversion: 2.1 time: 0.215130 Nov 19 13:38:08.250235 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.254164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 181/368] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:08 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 35560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:08.348218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:08.349224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:08.361632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.367457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.368827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.369244 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.465148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:08.479899 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e1b5ee12-8033-4857-a386-bebf4a9f2faa tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.245506 Nov 19 13:38:08.482621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 188/369] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:08 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:08.492632 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-69c42993-46d9-4c31-b6a6-2346d551ed8b req-c0d56c89-3a17-471b-8fdd-471b543139a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f548133d-928a-4fa3-9c06-f70a614f54d6", "tag": "b2596b0c-7f9e-4097-ad07-8fbd0a26f76f"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:08.494262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:38:08.494262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:38:08.507733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-69c42993-46d9-4c31-b6a6-2346d551ed8b req-c0d56c89-3a17-471b-8fdd-471b543139a6 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:08.508216 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-69c42993-46d9-4c31-b6a6-2346d551ed8b req-c0d56c89-3a17-471b-8fdd-471b543139a6 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:08.527778 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-69c42993-46d9-4c31-b6a6-2346d551ed8b req-c0d56c89-3a17-471b-8fdd-471b543139a6 service nova] Creating event network-changed:b2596b0c-7f9e-4097-ad07-8fbd0a26f76f for instance f548133d-928a-4fa3-9c06-f70a614f54d6 on hv-cinder-81735 Nov 19 13:38:08.533883 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-69c42993-46d9-4c31-b6a6-2346d551ed8b req-c0d56c89-3a17-471b-8fdd-471b543139a6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049672 Nov 19 13:38:08.535258 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 189/370] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:38:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:08.577908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:08.587562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c8bd641b-4839-4e80-ba8f-061bebd8f1a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.243153 Nov 19 13:38:08.598718 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 182/371] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:08 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:09.004087 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:09.004769 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:09.011472 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.011922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.012800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.013404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.082008 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:09.090125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a22c039a-ca06-4bd0-a88e-320a796dd2c4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1269 microversion: 2.1 time: 0.091791 Nov 19 13:38:09.091057 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 190/372] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:08 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:09.243888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:09.245180 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:09.252703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.253542 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.254591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.255132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.265667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:09.266677 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:09.276230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.276684 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.277522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.278133 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.359253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-738aacc5-6ff0-4ae4-b3ca-7a93e9ec9caf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 35922 microversion: 2.20 time: 0.118804 Nov 19 13:38:09.364069 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 183/373] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:09 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 35922 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:09.392379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-da2a471c-7848-414e-a112-ccad51350d0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 36196 microversion: 2.1 time: 0.133672 Nov 19 13:38:09.399654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 191/374] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:09 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 36196 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:09.500467 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:09.501163 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:09.508802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.509421 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.510231 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.510660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.607437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:09.608578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:09.618960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.619494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.620586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:09.621305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:09.703381 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:09.717546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a91a557b-eb11-4f92-9bb3-1e98e0393c8b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.222084 Nov 19 13:38:09.731650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 184/375] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:09 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:09.825051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:09.833882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6e542fd3-8a93-4e02-9118-9aac8a012997 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.232211 Nov 19 13:38:09.846038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 192/376] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:09 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:10.108815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:10.109839 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:10.123796 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.124655 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.125898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.126591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.384271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:10.386985 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:10.387668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:10.397390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d217ac69-e129-4eae-bf1a-6f4d8b95d9f4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.292995 Nov 19 13:38:10.397982 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 185/377] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:10 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:10.410821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.411318 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.412125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.412552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.413448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:10.414495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:10.421553 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.422278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.423269 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.423857 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.515389 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4f697d08-0122-4684-8439-a0e8b313c3dd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 36797 microversion: 2.1 time: 0.107594 Nov 19 13:38:10.516980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 186/378] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:10 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 36797 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:38:10.537379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-56b2d3cf-1a87-4977-b263-a9f1fa306463 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 36470 microversion: 2.20 time: 0.160599 Nov 19 13:38:10.539125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 193/379] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:10 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 36470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:10.745090 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:10.745090 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:10.747412 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.748025 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.749032 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.749468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.854321 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:10.862701 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:10.879124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.886201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:10.887548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:10.889435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.040291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:11.070584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e3f7fe0a-04de-416a-bd79-e19812a15835 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.335836 Nov 19 13:38:11.071780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 187/380] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:10 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:11.125997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:11.137258 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5a2b8391-43a0-4794-af51-f7550518982d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.284157 Nov 19 13:38:11.138734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 194/381] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:10 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:11.158531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-7b2cc183-22e0-4ae6-9fb8-d5110ca48fa8 req-51453166-da68-45b4-badc-81aa1adb3372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb3c92d-538c-4b70-b52f-345065c501a6", "tag": "7b476506-aeb7-452f-b36d-cd93461bf7a9"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:11.161757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:38:11.161757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:38:11.172285 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-7b2cc183-22e0-4ae6-9fb8-d5110ca48fa8 req-51453166-da68-45b4-badc-81aa1adb3372 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.173326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-7b2cc183-22e0-4ae6-9fb8-d5110ca48fa8 req-51453166-da68-45b4-badc-81aa1adb3372 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.187262 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-7b2cc183-22e0-4ae6-9fb8-d5110ca48fa8 req-51453166-da68-45b4-badc-81aa1adb3372 service nova] Creating event network-changed:7b476506-aeb7-452f-b36d-cd93461bf7a9 for instance 9bb3c92d-538c-4b70-b52f-345065c501a6 on hv-cinder-81735 Nov 19 13:38:11.192436 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-7b2cc183-22e0-4ae6-9fb8-d5110ca48fa8 req-51453166-da68-45b4-badc-81aa1adb3372 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039346 Nov 19 13:38:11.193147 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 188/382] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:38:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:38:11.416567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:11.417181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:11.423592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.424051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.425035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.425795 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.530527 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:11.532428 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:11.539278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.540094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.542066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.545463 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.647958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-faa5bfa2-de27-4611-9c44-ea4944c26aa6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 37563 microversion: 2.1 time: 0.122448 Nov 19 13:38:11.649309 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 189/383] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:11 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 37563 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:38:11.658547 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:11.660047 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:11.668995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.669913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.671136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:11.672009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:11.807569 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-59ea698c-4be2-4847-9edd-f75c64a533b0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 37233 microversion: 2.20 time: 0.156289 Nov 19 13:38:11.809325 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 190/384] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:11 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 37233 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:11.817981 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:11.826015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-30ce41be-eb40-45ea-84f2-a0ad2d71d898 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.413188 Nov 19 13:38:11.826636 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 195/385] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:11 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:12.089740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:12.090554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:12.101227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.101865 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.102694 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.103132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.155795 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:12.156413 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:12.170924 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.173069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.174118 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.174718 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.522482 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:12.530868 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2e0f526c-b9d2-49a1-aa95-dfa5e9634d2c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.446628 Nov 19 13:38:12.531610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 191/386] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:12 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:12.612296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:12.620046 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-75a8e219-80a2-448d-8ac3-2975eaf0234c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.468534 Nov 19 13:38:12.620589 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 196/387] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:12 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:12.666993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:12.667950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:12.676998 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.677456 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.678217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.678906 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.783703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0b9b4ed4-7f42-46c3-8397-c0af6f70df5b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 38056 microversion: 2.1 time: 0.126750 Nov 19 13:38:12.784867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 192/388] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:12 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 38056 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:12.821026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:12.822055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:12.829154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.829600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.830392 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.830823 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.844585 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:12.845365 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:12.853506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.854214 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.855220 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:12.855909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:12.923482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-522b647e-ddec-4585-bde3-61d5d23562f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 37720 microversion: 2.20 time: 0.106133 Nov 19 13:38:12.925247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 197/389] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:12 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 37720 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:13.007425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:13.016546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7b911a83-34c8-443f-9a31-4a295f4f3381 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.176258 Nov 19 13:38:13.017083 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 193/390] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:12 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:13.551886 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:13.552697 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:13.562178 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.562622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.563451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.564193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.638423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:13.638972 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:13.646003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.646451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.647856 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.648317 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.737548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:13.746639 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7b8c4f4d-4828-41fd-9419-6e6b00b50b76 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.200277 Nov 19 13:38:13.747436 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 198/391] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:13 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:13.799015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:13.799992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:13.806041 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.806486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.807345 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.807759 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.810911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:13.819033 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c8d4a2a2-de50-4220-bbde-63f50ce52f59 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.184573 Nov 19 13:38:13.819718 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 194/392] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:13 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:13.894857 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-851d4d5d-4ed7-47a6-8278-876cb5188636 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 38109 microversion: 2.1 time: 0.099804 Nov 19 13:38:13.895570 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 199/393] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:13 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 38109 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:13.937127 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:13.938124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:13.945299 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.945761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:13.946550 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:13.946983 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.037317 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:14.038489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:14.048134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:14.048573 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.049354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:14.049779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.063805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-54f95c6c-efcb-421f-8026-4e6e237b7cd9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 38035 microversion: 2.20 time: 0.131161 Nov 19 13:38:14.064520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 195/394] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:13 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 38035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:14.196310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:14.204298 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de499235-7fa2-431e-a654-42ab4bc46a5a tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.173632 Nov 19 13:38:14.204877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 200/395] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:14 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:14.765934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:14.766887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:14.780419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:14.780419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.784290 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:14.784981 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.838877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:14.839716 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:14.848410 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:14.849538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.851386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:14.852198 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:14.992744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:15.001521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ece76869-157d-4db8-8b03-12c7058354f9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.240990 Nov 19 13:38:15.002122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 196/396] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:14 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:15.006999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:15.007967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:15.015194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.015667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.016479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.016924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.054292 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:15.063181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-07bb3aec-f146-4bd1-af29-cc42bf352ef6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.228342 Nov 19 13:38:15.064240 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 201/397] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:14 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:15.080683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:15.082381 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:15.090601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.093532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.093532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.093532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.113289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-16d5f1f4-2040-45d7-8752-d5844f5fcfa5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 200 len: 38184 microversion: 2.1 time: 0.109579 Nov 19 13:38:15.119328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 197/398] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:15 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 38184 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:15.119538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-9e2e44d8-09cd-4f29-aef6-ef9e7304e495 req-2d29ed5a-889b-434c-b4f9-f31a1f2ceb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f548133d-928a-4fa3-9c06-f70a614f54d6", "name": "network-vif-plugged", "status": "completed", "tag": "b2596b0c-7f9e-4097-ad07-8fbd0a26f76f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:15.121076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:38:15.121076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:38:15.129674 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-9e2e44d8-09cd-4f29-aef6-ef9e7304e495 req-2d29ed5a-889b-434c-b4f9-f31a1f2ceb3f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.130215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-9e2e44d8-09cd-4f29-aef6-ef9e7304e495 req-2d29ed5a-889b-434c-b4f9-f31a1f2ceb3f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.142270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-9e2e44d8-09cd-4f29-aef6-ef9e7304e495 req-2d29ed5a-889b-434c-b4f9-f31a1f2ceb3f service nova] Creating event network-vif-plugged:b2596b0c-7f9e-4097-ad07-8fbd0a26f76f for instance f548133d-928a-4fa3-9c06-f70a614f54d6 on hv-cinder-81735 Nov 19 13:38:15.151864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-9e2e44d8-09cd-4f29-aef6-ef9e7304e495 req-2d29ed5a-889b-434c-b4f9-f31a1f2ceb3f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Nov 19 13:38:15.152487 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 198/399] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:15.158083 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:15.158976 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:15.165889 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.166448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.167563 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.168305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.192655 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-01f5a562-1bf9-4c72-9e3b-7771dbd29e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 38035 microversion: 2.20 time: 0.118626 Nov 19 13:38:15.198316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c25bc414-7a3a-42fe-a6fa-e7e9d881996c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/ips" status: 200 len: 147 microversion: 2.1 time: 0.044402 Nov 19 13:38:15.209801 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 199/401] 10.222.0.74 () {58 vars in 1247 bytes} [Fri Nov 19 13:38:15 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:15.210005 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 202/401] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:15 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 38035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:15.222037 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:15.222654 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:15.228764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.229213 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.230011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:15.230441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:15.377897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:15.385473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a966fec0-8980-4d8c-a99e-9e1cbe3300ae tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.167882 Nov 19 13:38:15.386060 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 200/402] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:15 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:16.019186 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:16.019961 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:16.027714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.028183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.029090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.029566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.085617 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:16.086386 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:16.096412 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.097199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.098022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.099412 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.212285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:16.221362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-69b010d2-f444-4747-b6ba-6826862c2522 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1319 microversion: 2.1 time: 0.206531 Nov 19 13:38:16.221958 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 203/403] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:16 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:16.230836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:16.230836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:16.235035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.235587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.236440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.236819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.296757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:16.305056 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5b80d8e9-972e-44b0-a66b-fcfb7ea88e12 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.223402 Nov 19 13:38:16.305649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 201/404] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:16 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:16.330682 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-24380b07-6feb-42bd-a11d-3faedea6cccd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 200 len: 38173 microversion: 2.20 time: 0.107384 Nov 19 13:38:16.331363 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 204/405] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:16 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 38173 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:16.341999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:16.342437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:16.348780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.349249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.350040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.350469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.383588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fe9fa4d5-a4e4-4973-8ff9-691de73d540f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.045229 Nov 19 13:38:16.384187 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 202/406] 10.222.0.74 () {60 vars in 1288 bytes} [Fri Nov 19 13:38:16 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:38:16.404116 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:16.404892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:16.413129 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.413878 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.414817 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:16.415357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:16.599464 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:16.607248 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-207895c1-1c5b-486e-88d7-295973db95c3 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.207651 Nov 19 13:38:16.608097 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 205/407] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:16 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:17.241332 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:17.242044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:17.258356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:17.258894 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:17.264677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:17.265209 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:17.322819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:17.324690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:17.346057 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:17.355223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:17.356992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:17.357714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:17.546056 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:17.554859 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-840dcac2-72ec-4315-a807-02bac584e7de tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1507 microversion: 2.1 time: 0.318649 Nov 19 13:38:17.567727 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 203/408] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:17 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:17.604735 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:17.615974 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-158060a7-dd7a-45c9-b4bd-f72800b3a247 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.297039 Nov 19 13:38:17.628554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:17.628554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:17.634878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:17.635412 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:17.636935 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:17.637781 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:17.641332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 206/409] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:17 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:17.843414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:17.852922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5a67942d-4cb7-4aa9-8a75-e6d87504086d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.231875 Nov 19 13:38:17.853715 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 204/410] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:17 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:18.522645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "111f2410-37f1-4d1c-8289-457784f8c860"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:18.523750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:18.530531 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:18.530989 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:18.531925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:18.532364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:18.634027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:18.634669 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:18.641662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:18.642284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:18.643003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:18.643467 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:18.894875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:18.907966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d43d41fd-9372-4bbc-b1d3-fcbc56ae89ca tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.277863 Nov 19 13:38:18.909328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 205/411] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:18 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:18.915338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:18.916276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:18.925087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:18.925305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bfb74e32-aa1f-4c91-98f3-a928c9af0854 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405281 Nov 19 13:38:18.925958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:18.926315 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 207/412] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:38:18 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:18.927136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:18.928406 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:19.045639 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-65002b59-cc17-4ef8-a561-bc35c3926d51 req-683dd587-9189-4f08-a9ec-331f5c74adb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb3c92d-538c-4b70-b52f-345065c501a6", "name": "network-vif-plugged", "status": "completed", "tag": "7b476506-aeb7-452f-b36d-cd93461bf7a9"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:19.047727 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:38:19.047727 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:38:19.061494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-65002b59-cc17-4ef8-a561-bc35c3926d51 req-683dd587-9189-4f08-a9ec-331f5c74adb3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:19.062162 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-65002b59-cc17-4ef8-a561-bc35c3926d51 req-683dd587-9189-4f08-a9ec-331f5c74adb3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:19.085568 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-65002b59-cc17-4ef8-a561-bc35c3926d51 req-683dd587-9189-4f08-a9ec-331f5c74adb3 service nova] Creating event network-vif-plugged:7b476506-aeb7-452f-b36d-cd93461bf7a9 for instance 9bb3c92d-538c-4b70-b52f-345065c501a6 on hv-cinder-81735 Nov 19 13:38:19.091268 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-65002b59-cc17-4ef8-a561-bc35c3926d51 req-683dd587-9189-4f08-a9ec-331f5c74adb3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050611 Nov 19 13:38:19.092673 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 208/413] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:38:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:38:19.138135 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:19.157811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2251788f-7782-4230-8946-0f1e9452ca22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.246647 Nov 19 13:38:19.167682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 206/414] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:18 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:19.775229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:19.775855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:19.782391 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:19.783067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:19.784048 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:19.784479 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:19.812679 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lazy-loading 'flavor' on Instance uuid 6d127235-a875-411b-939b-ee6f9b1ae4c1 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:38:19.936573 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:19.937166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:19.943979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:19.944634 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:19.945588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:19.946172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:20.187974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:20.198394 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-12917398-9aa2-4738-b892-8757062a04ef tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.265850 Nov 19 13:38:20.199048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 207/415] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:19 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:20.204483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:20.205355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:20.219572 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:20.221318 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:20.223588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:20.225800 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:20.270916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-18e6e25f-23cb-4b90-b494-738f83bef943 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 202 len: 0 microversion: 2.20 time: 0.500408 Nov 19 13:38:20.271654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 209/416] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:38:19 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:38:20.282222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:20.283297 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:20.290882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:20.291648 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:20.296415 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:20.297249 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:20.455988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:20.463736 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e12cdf5f-d4d6-4004-9c75-efb879169ad9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.263688 Nov 19 13:38:20.464475 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 208/417] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:20 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:20.517041 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:20.525222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:20.526686 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:20.528090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c65d0a18-8a55-45a0-84f5-ab0f4357c3ba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.250434 Nov 19 13:38:20.528821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 210/418] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:20 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:21.216401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:21.217016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:21.224148 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:21.224602 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:21.225407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:21.225843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:21.381307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:21.391805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0c5e2960-b602-487d-b9be-c0b7848d49b5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.179345 Nov 19 13:38:21.392389 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 209/419] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:21 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:21.482990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:21.483791 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:21.490605 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:21.491051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:21.491986 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:21.492420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:21.549737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:21.550337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:21.556711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:21.557124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:21.558286 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:21.558890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:21.679807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:21.688382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f8669cae-a34a-44fd-ba7d-8ba6d4f3ab04 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.209817 Nov 19 13:38:21.689222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 211/420] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:21 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:21.726162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:21.737495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:21.739151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:21.740433 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-eab10462-05ad-4dc2-9c1f-23b039c30f07 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.194945 Nov 19 13:38:21.741059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 210/421] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:21 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:38:22.412872 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:22.413504 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:22.420137 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:22.420628 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:22.421609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:22.422115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:22.567014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:22.575469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fe5d1204-7aed-4e5e-a9bb-7e48f1ce8720 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.170201 Nov 19 13:38:22.576338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 212/422] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:22 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:22.705874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:22.706490 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:22.713344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:22.713787 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:22.714595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:22.715027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:22.760664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:22.761240 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:22.767474 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:22.767928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:22.768730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:22.769161 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:22.881132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:22.888764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-10aceb7e-729b-4aef-8d37-da27c63b7c3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.186795 Nov 19 13:38:22.889628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 211/423] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:22 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:22.942387 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:22.950512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:22.952246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:22.953651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bc5c5afa-b01d-48b8-8e93-4842a6a4e2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.196990 Nov 19 13:38:22.954198 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 213/424] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:22 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:23.604299 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:23.604801 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:23.613005 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:23.613463 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:23.614263 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:23.614711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:23.772515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:23.780680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d3072e83-3944-4840-b206-9a414b48818f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.185653 Nov 19 13:38:23.781622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 212/425] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:23 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:23.906417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:23.907803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:23.913840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:23.914293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:23.915105 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:23.915553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:23.978135 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:23.978779 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:23.987360 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:23.987814 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:23.988619 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:23.989229 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:24.123127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:24.133506 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c13eb633-0eea-446b-bb16-10c765cf50c6 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1317 microversion: 2.1 time: 0.231335 Nov 19 13:38:24.134197 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 214/426] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:23 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:24.178057 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:24.187843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:24.189340 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:24.190536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cb94ba65-ab2b-4c12-8f1f-e3c5284d8854 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.221863 Nov 19 13:38:24.191119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 213/427] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:23 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:24.798540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:24.799257 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:24.806395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:24.806965 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:24.807919 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:24.808453 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:24.961660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:24.970080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-76b6c283-3f76-420f-bcf6-25670ca7bb54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.176094 Nov 19 13:38:24.970653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 215/428] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:24 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:25.153002 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:25.153673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:25.161156 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:25.161682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:25.162595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:25.163428 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:25.209227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:25.209829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:25.216191 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:25.216483 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:25.217489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:25.217968 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:25.338596 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:25.352996 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6f6d2a7b-fb83-4c1d-8fde-c0be87cb4a22 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1506 microversion: 2.1 time: 0.204922 Nov 19 13:38:25.358677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 214/429] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:25 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:25.418849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:25.430321 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:25.431873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:25.433066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-031828d8-93eb-4617-b890-c0f29f6fe7aa tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.227628 Nov 19 13:38:25.433627 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 216/430] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:25 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:25.991618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:25.992588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:25.999587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:26.000280 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:26.001089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:26.001624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:26.149631 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:26.158878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2eb0eb7c-1715-4241-8ce5-f420bbc5c7eb tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.174240 Nov 19 13:38:26.159618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 215/431] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:25 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:26.453296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:26.453925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:26.470205 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:26.470529 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:26.471390 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:26.472070 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:26.703725 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:26.717517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:26.720494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:26.722484 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6d69654f-36d9-476a-8fff-fd7176aa65b2 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.273539 Nov 19 13:38:26.723699 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 217/432] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:26 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:27.178474 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:27.179378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:27.187218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.187661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.188459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.188888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.336953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:27.345374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-96d3c809-ae9a-4ec8-a047-41754f5078a3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.172252 Nov 19 13:38:27.345996 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 216/433] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:27 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:27.644090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-95f81ec3-9d5e-4502-abfd-a976d4ed7025 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:27.651579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95f81ec3-9d5e-4502-abfd-a976d4ed7025 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.652096 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95f81ec3-9d5e-4502-abfd-a976d4ed7025 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.721882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-95f81ec3-9d5e-4502-abfd-a976d4ed7025 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Going to try to stop instance {{(pid=122814) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 13:38:27.747945 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:27.748563 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:27.754525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.754973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.755799 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.756242 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.791161 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-95f81ec3-9d5e-4502-abfd-a976d4ed7025 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 202 len: 0 microversion: 2.1 time: 0.151241 Nov 19 13:38:27.802799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 218/434] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:27 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:27.802799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:27.803206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:27.813826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.814612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.815678 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:27.816638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:27.997523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:28.011540 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:28.015542 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:28.017899 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5c258120-c198-4fc5-8346-f7d8147fdd15 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.273197 Nov 19 13:38:28.019139 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 217/435] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:27 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:38:28.024531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38f63bf4-637d-4fb5-8c2e-8c31aa8436ed"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:28.025849 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:28.035279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:28.036073 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:28.037084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:28.037988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:28.040264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:28.049704 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-49fc5629-2677-44a5-bc4d-3e389e1dd33a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.253060 Nov 19 13:38:28.050351 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 219/436] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:27 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:28.308000 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c8929d02-5ee5-4697-b7e5-8b4cc2ae7d0b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "POST /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287205 Nov 19 13:38:28.314142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 218/437] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:38:28 2021] POST /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:28.363880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:28.364485 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:28.379199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:28.379199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:28.379199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:28.379199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:28.523845 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:28.536951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6812746d-df92-45f8-b6f5-2400a70a87c6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.176642 Nov 19 13:38:28.537682 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 220/438] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:28 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:29.042309 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:29.043126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:29.049648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.050238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.051300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.051834 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.067308 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:29.068496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:29.078032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.078734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.079817 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.080526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.280456 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:29.292778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:29.293779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:29.294737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:29.296246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a3ef4f77-74cc-4154-b87e-e5e98504963a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.261959 Nov 19 13:38:29.297029 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 219/439] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:29 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:29.302639 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-05825885-ecf2-4b7f-b886-363fea5ff8b0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.239409 Nov 19 13:38:29.329459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 221/440] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:29 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:29.553892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:29.554577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:29.561379 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.561832 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.562644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.563254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.742635 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:29.750303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1ac6ab81-fb02-4366-bfb4-8118fa87de19 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1501 microversion: 2.1 time: 0.200289 Nov 19 13:38:29.751302 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 220/441] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:29 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:29.768006 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf6fa3f3-d7be-4f80-9d3d-c8a86ee2d9c0"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:29.769143 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:29.777090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.777641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.778488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.779061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.806677 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] HTTP exception thrown: Cannot 'attach_volume' instance a4794168-fa1e-43da-a27c-e5e83054dd1e while it is in vm_state rescued Nov 19 13:38:29.807640 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Returning 409 to user: Cannot 'attach_volume' instance a4794168-fa1e-43da-a27c-e5e83054dd1e while it is in vm_state rescued {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:38:29.808935 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-636188b9-73b0-4be7-91d4-0b93c7c1278b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045345 Nov 19 13:38:29.809732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 222/442] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:38:29 2021] POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 19 13:38:29.824116 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:29.824978 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:29.831536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.831987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.832776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.833209 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.916541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-335bce7a-d791-43df-8d1a-50a21887e001 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action" status: 202 len: 0 microversion: 2.1 time: 0.096361 Nov 19 13:38:29.917578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 221/443] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:29 2021] POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:29.926385 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:29.927333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:29.935693 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.936254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:29.937258 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:29.937736 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:30.164204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:30.177860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-66e614ed-7307-48bc-8f52-6f1aece27a3d tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.255172 Nov 19 13:38:30.179029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 223/444] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:29 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:30.319314 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:30.320029 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:30.320956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:30.321897 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:30.327446 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:30.327875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:30.329038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:30.329202 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:30.329516 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:30.329633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:30.330499 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:30.331006 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:30.629708 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:30.643616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:30.644208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:30.646763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:30.648925 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9f000b60-0943-41f5-8596-8f7a1bb33539 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.335421 Nov 19 13:38:30.659143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 222/445] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:30 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:30.665055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ca781d89-b604-4a31-a492-95b1b55ec732 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.346530 Nov 19 13:38:30.666115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 224/446] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:30 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:31.206337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:31.206852 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:31.213306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:31.215217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:31.216013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:31.216439 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:31.352320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:31.361123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cca1c2e7-fc05-48e5-b8f1-f2710278817b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.158513 Nov 19 13:38:31.361685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 223/447] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:31 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:31.673453 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:31.674025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:31.681167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:31.681619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:31.682390 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:31.682521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:31.682968 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:31.683307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:31.690300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:31.690754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:31.691580 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:31.692001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:31.891481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:31.894835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:31.899854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7b4d2e73-bd02-4d39-a377-375d0fd512d6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.220956 Nov 19 13:38:31.900538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 224/448] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:31 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:31.902974 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:31.904489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:31.905891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8e45cc6c-7579-4c7f-a112-8fcfa5d498fc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.236555 Nov 19 13:38:31.906620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 225/449] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:31 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:32.381607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:32.382842 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:32.393376 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:32.393826 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:32.394629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:32.395068 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:32.538649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:32.546841 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7e33d984-183b-414c-8f26-cdf666bbd6e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.172318 Nov 19 13:38:32.547563 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 225/450] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:32 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:32.918389 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:32.919702 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:32.925027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:32.925762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:32.927810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:32.928260 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:32.929100 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:32.929651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:32.932413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:32.932413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:32.932413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:32.932413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:33.153958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:33.161631 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:33.165897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:33.167564 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:33.169020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1140c749-15aa-491d-8b2a-6a277ab0b713 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.248111 Nov 19 13:38:33.176047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a09f51e7-b381-4912-9144-2862f3dfdc44 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.261459 Nov 19 13:38:33.176884 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 226/451] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:32 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:33.180720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 226/452] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:32 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:33.566916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:33.567599 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:33.574011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:33.574481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:33.575343 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:33.575787 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:33.745411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:33.754131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f378333d-023c-489c-b91f-752e9165f701 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.191329 Nov 19 13:38:33.754755 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 227/453] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:33 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:34.188305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:34.188969 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:34.194356 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:34.194929 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:34.196492 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:34.196950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:34.197757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:34.198198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:34.202046 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:34.202467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:34.203313 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:34.203783 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:34.416651 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:34.425653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:34.426766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:34.428319 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:34.429674 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b8f7dc07-c47c-4094-a7e1-fa7d9bd11b32 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.245760 Nov 19 13:38:34.430744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 227/454] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:34 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:34.443246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-64e81da3-4737-467a-a716-fb5a9d699cbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.252575 Nov 19 13:38:34.443844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 228/455] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:34 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:34.773704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:34.774780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:34.784605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:34.785254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:34.786298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:34.787343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:34.950760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:34.958647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e84f41e4-d644-4355-aed0-71538e2838fa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.191131 Nov 19 13:38:34.959628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 228/456] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:34 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:35.450332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:35.451005 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:35.458663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:35.459141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:35.460012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:35.460473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:35.460658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:35.461492 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:35.468336 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:35.468779 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:35.469549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:35.469977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:35.657597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:35.666589 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:35.667012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:35.668559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:35.669757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6d3edc3e-f1bc-4e8c-b94d-2d19a8e204cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.223478 Nov 19 13:38:35.670350 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 229/457] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:35 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:35.675933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e20fda95-3d44-4dce-887a-cd4b0d5c93ee tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.219034 Nov 19 13:38:35.676746 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 229/458] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:35 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:35.976586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:35.977131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:35.983683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:35.984122 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:35.984908 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:35.985357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:36.142055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:36.150685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d10a4405-6586-48f3-9520-c032a09f5287 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.177976 Nov 19 13:38:36.151289 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 230/459] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:35 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:36.689322 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:36.689878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:36.694143 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:36.694819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:36.698692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:36.699264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:36.700138 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:36.700622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:36.702337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:36.702794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:36.703626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:36.704061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:36.902237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:36.906600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:36.910868 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:36.912379 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:36.913922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d798b770-164b-4777-a8eb-70a0f23cfe1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.229095 Nov 19 13:38:36.914820 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 230/460] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:36 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:36.916514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b1f5763f-fc99-4dc3-bb15-2192b5f1b784 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.226472 Nov 19 13:38:36.917354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 231/461] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:36 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:37.168513 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:37.169106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:37.175539 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:37.175984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:37.176746 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:37.177180 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:37.331905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:37.344306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-be2abd9c-056c-4f25-ba7c-d71482286198 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.179191 Nov 19 13:38:37.345197 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 231/462] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:37 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:37.933417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:37.933953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:37.934322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:37.934409 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:37.941073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:37.941226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:37.941525 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:37.941675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:37.942317 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:37.942452 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:37.942752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:37.942888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:38.154099 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:38.157949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:38.164870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8425c366-b432-4a23-b148-229deaccbee5 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.235005 Nov 19 13:38:38.166090 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 232/463] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:37 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:38.169428 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:38.170988 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:38.172402 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-dee9c6c2-59d6-4b09-886b-589a328cb0a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.243181 Nov 19 13:38:38.175126 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 232/464] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:37 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:38.364280 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:38.364903 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:38.370863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:38.371358 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:38.372153 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:38.372591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:38.528857 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:38.539719 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9cc9f15a-bd86-4cf9-9237-4d3bd3578751 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.179172 Nov 19 13:38:38.540316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 233/465] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:38 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:39.182057 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:39.183125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:39.191466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:39.192078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:39.192834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.193308 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.194217 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.194743 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.200848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.201493 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.202660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.203934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.406447 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:39.410447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:39.414604 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-57a3a5ce-612b-4a43-829e-dd8b4d79431b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.236572 Nov 19 13:38:39.415198 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 233/466] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:39 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:39.419296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:39.419831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:39.420301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:39.420723 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:39.422112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a58c7832-4194-4d27-ab4e-1e46d0b2f7de tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.234357 Nov 19 13:38:39.422650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 234/467] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:39 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:39.426364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.426806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.427617 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.428047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.551327 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'services' on Instance uuid 9bb3c92d-538c-4b70-b52f-345065c501a6 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:38:39.558821 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:39.559550 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:39.566629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.567257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.568246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.568768 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.676818 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a3899722-473a-4ba3-bec0-f0b18116cae1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments/38f63bf4-637d-4fb5-8c2e-8c31aa8436ed" status: 202 len: 0 microversion: 2.1 time: 0.260009 Nov 19 13:38:39.677462 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 234/468] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:38:39 2021] DELETE /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments/38f63bf4-637d-4fb5-8c2e-8c31aa8436ed => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:39.686858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:39.688228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:39.694667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.695132 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.695999 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:39.696434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:39.714050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:39.721854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4fe9b8d7-4cce-4791-9073-680567b1c7f5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.167683 Nov 19 13:38:39.722458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 235/469] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:39 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:39.727761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4501c453-fd2a-4b4e-a27f-60c4ec3d0e97 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Nov 19 13:38:39.728288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 235/470] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:39 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:40.431647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:40.432468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:40.440021 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.440485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.441271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.441746 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.442760 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:40.443424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:40.451217 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.451669 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.452484 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.452907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.657692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:40.661345 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:40.666571 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5b6b398a-d97a-4848-a83b-ee144d064c0e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.238669 Nov 19 13:38:40.667430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 236/471] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:40 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:40.669932 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:40.671440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:40.672584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4a57ff24-d418-47da-b8f2-daacd5b49467 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.235220 Nov 19 13:38:40.673123 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 236/472] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:40 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:40.738804 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:40.739205 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:40.739372 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:40.740151 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:40.745967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.746424 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.746591 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.746995 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.747224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.747660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.747888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:40.748317 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:40.779876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-02ec5324-66f2-465e-ab9b-73307ddf284c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Nov 19 13:38:40.780423 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 237/473] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:40 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:40.899326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:40.907345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1c5e5e11-e5a2-466c-9cd5-2b2947142513 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.172211 Nov 19 13:38:40.907917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 237/474] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:40 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:41.685435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:41.685977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:41.691575 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:41.692154 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:41.692574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:41.693025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:41.693816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:41.694243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:41.698987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:41.699477 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:41.700312 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:41.700697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:42.114602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:42.118878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:42.123112 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-195809c9-97d1-4f3b-9a76-974a77d53434 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.442615 Nov 19 13:38:42.123804 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 238/475] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:41 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:42.127390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:42.128501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:42.128884 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:42.129471 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:42.130055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c86733af-0b24-4714-bf9c-52a97de45cc6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.442417 Nov 19 13:38:42.130615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 238/476] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:41 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:42.135472 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:42.135810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:42.135941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:42.136401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:42.136705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:42.137100 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:42.142851 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:42.143332 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:42.144087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:42.144515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:42.167702 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bad5ef04-1719-4146-85ff-12b2fe7343fd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Nov 19 13:38:42.168280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 239/477] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:42 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:42.279790 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:42.290273 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3e68f3fc-b760-49c5-a9fe-f035b8ace3e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1509 microversion: 2.1 time: 0.158472 Nov 19 13:38:42.290831 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 239/478] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:42 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:43.141387 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:43.141942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:43.148696 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.149120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:43.149585 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.149753 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:43.149917 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.150308 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.156767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.157218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.158018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.158449 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.358068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:43.363316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:43.366370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d124b2ef-e5c4-4366-9137-984aaa8c363b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.228834 Nov 19 13:38:43.366949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 240/479] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:43 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:43.371332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:43.372572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:43.374511 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:43.378656 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.379138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.380179 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.380611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.382643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:43.384916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2fb8f59a-0da8-4194-aa50-bd3844389895 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.239812 Nov 19 13:38:43.385745 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 240/480] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:43 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:43.394052 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:43.395176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:43.405603 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.406419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.407685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:43.408445 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:43.416973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-68ed7626-10f0-4df1-ae92-1b87c1905471 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Nov 19 13:38:43.417747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 241/481] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:43 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:43.582401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:43.590125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f297204d-86c5-48d5-935a-01868580cebd tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1515 microversion: 2.1 time: 0.203038 Nov 19 13:38:43.590713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 241/482] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:43 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:44.385925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:44.386571 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:44.393482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.393929 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.394710 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.395134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.415152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:44.415821 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:44.423470 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.423920 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.425028 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.425457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.595645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:44.603864 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fa5d76f1-1146-4579-a339-3d833c4b1318 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.221888 Nov 19 13:38:44.604447 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 242/483] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:44 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:44.609113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:44.610030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:44.615920 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:44.618776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.619267 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.620086 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.620517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.625538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:44.630593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:44.631906 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8986ec9e-79c9-44f2-bc7e-77a80cad112c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1743 microversion: 2.20 time: 0.220858 Nov 19 13:38:44.632516 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 242/484] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:44 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1743 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:44.656220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a462535d-a7c9-48d3-8c1d-7470521fdf7b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050719 Nov 19 13:38:44.656772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 243/485] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:38:44 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:38:44.931934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:44.932562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:44.939843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.940296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:44.941094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:44.941630 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.085367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:45.104228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e86dda24-1454-4d34-9b30-9f2a08dad69a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1515 microversion: 2.1 time: 0.166333 Nov 19 13:38:45.104228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 243/486] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:44 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:45.114592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "574d8478-fde4-4fc3-aad1-6a952f448c9e"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:45.115183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:45.121160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.121595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.122371 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.122852 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.402300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ccf71ed3-487e-4a71-af5f-28443aedca42 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292018 Nov 19 13:38:45.403286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 244/487] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:38:45 2021] POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:38:45.625676 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:45.627059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:45.635965 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.636810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.637797 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.638276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.652076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:45.652765 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:45.660042 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.660487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.661277 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.661922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.852494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:45.859371 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:45.867413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f1b21dac-3fc1-426d-8334-b2c79ca4cd5e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.248804 Nov 19 13:38:45.868264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 244/488] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:45 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:45.869064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:45.871213 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:45.872843 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-254122ef-626c-4891-b5cc-e7ca51a7fcca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1743 microversion: 2.20 time: 0.225375 Nov 19 13:38:45.873574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 245/489] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:45 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:38:45.873819 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:45.874339 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:45.880791 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.881240 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.882040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:45.882519 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:45.908697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:38:45.996166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6b3d6e63-876d-44b6-820a-a51c9ec1fe03 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 204 len: 0 microversion: 2.1 time: 0.125056 Nov 19 13:38:45.997030 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 245/490] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:38:45 2021] DELETE /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:38:46.005526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:46.006256 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:46.012566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:46.013012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:46.014245 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:46.014727 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:46.161912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:46.170351 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f579c7ca-30e8-4c2c-8567-dc0541decbc0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1512 microversion: 2.1 time: 0.169091 Nov 19 13:38:46.170910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 246/491] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:45 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:46.888833 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:46.890112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:46.892620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:46.893359 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:46.898145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:46.898793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:46.899827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:46.900254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:46.900787 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:46.901275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:46.903439 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:46.904060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:47.136377 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:47.144708 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:47.150202 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:47.152101 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:47.153631 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3b97eefc-8e34-4e54-8729-4c98bba5dcbc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.265188 Nov 19 13:38:47.154786 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-671eddbf-33ce-42b2-8aa4-4d03afac8906 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.272354 Nov 19 13:38:47.155027 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 247/492] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:46 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:47.159609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 246/493] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:46 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:47.168502 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-a703b777-e615-4f18-97ab-b4d0134f9587 req-03355104-bdcf-4748-9e86-a994dd5e2e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "name": "network-vif-plugged", "status": "completed", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:47.170562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:38:47.170562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:38:47.178622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a703b777-e615-4f18-97ab-b4d0134f9587 req-03355104-bdcf-4748-9e86-a994dd5e2e5f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:47.179081 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a703b777-e615-4f18-97ab-b4d0134f9587 req-03355104-bdcf-4748-9e86-a994dd5e2e5f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:47.188195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:47.188856 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:47.194457 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-a703b777-e615-4f18-97ab-b4d0134f9587 req-03355104-bdcf-4748-9e86-a994dd5e2e5f service nova] Creating event network-vif-plugged:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:38:47.195269 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:47.195883 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:47.197058 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:47.197644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:47.199910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-a703b777-e615-4f18-97ab-b4d0134f9587 req-03355104-bdcf-4748-9e86-a994dd5e2e5f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043456 Nov 19 13:38:47.200504 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 248/494] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:47.344271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:47.352138 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4b265c0a-d097-489d-a01c-305ce43baab5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1512 microversion: 2.1 time: 0.168086 Nov 19 13:38:47.352746 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 247/495] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:47 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:48.172924 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:48.173481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:48.173844 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:48.174857 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:48.180346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:48.180814 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:48.181610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:48.181871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:48.182118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:48.183204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:48.183518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:48.183951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:48.376189 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:48.385666 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:48.386577 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:48.387761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:48.389256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7dcbd523-e867-47cb-8dfa-dfd942543c37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.219950 Nov 19 13:38:48.390500 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 248/496] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:48 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:48.394722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:48.395352 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:48.396354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0338cdfb-2467-4c03-97ad-d03566a6c21a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.228275 Nov 19 13:38:48.405751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 249/497] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:48 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:48.405932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:48.405932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:48.405932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:48.405932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:48.550180 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:48.558284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bd5b9131-3a42-4577-b97e-cdf32016e52c tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1512 microversion: 2.1 time: 0.166906 Nov 19 13:38:48.558890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 249/498] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:48 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:49.408965 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:49.410004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:49.418346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:49.419237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:49.420926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:49.421914 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:49.423041 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:49.423673 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:49.427385 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:49.427862 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:49.428627 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:49.429051 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:49.642043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:49.651794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:49.653094 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:49.654305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cedcd8f7-86fb-4457-b741-6b268f243c78 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.249708 Nov 19 13:38:49.655031 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 250/499] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:49 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:49.658319 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:49.659907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:49.660574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:49.667221 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-697e61e3-5bc9-4a9b-8062-cbe610835286 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1723 microversion: 2.1 time: 0.256969 Nov 19 13:38:49.668604 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 250/500] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:49 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:49.668990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:49.669580 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:49.670411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:49.670846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:49.836017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:49.843748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9439a10e-392d-4292-9f3e-e763991ad6a1 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1512 microversion: 2.1 time: 0.187567 Nov 19 13:38:49.844460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 251/501] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:49 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:50.674738 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:50.675470 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:50.681850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:50.682306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:50.686269 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:50.687038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:50.689419 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:50.690536 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:50.697896 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:50.698670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:50.699978 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:50.700633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:50.954505 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:50.966084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e3934afb-7e56-4416-ac33-edaa42cbcdcf tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1700 microversion: 2.1 time: 0.282967 Nov 19 13:38:50.979295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 252/502] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:50 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1700 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:50.987990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:50.989091 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:50.989544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:50.996253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:50.996985 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:50.998001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:50.998629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:50.999346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:51.001323 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:51.002979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d5e8aba9-c440-4a47-b98d-c8eab9390f1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.332255 Nov 19 13:38:51.006155 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 251/503] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:50 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:38:51.022744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a42b33de-4a97-46f0-a39a-0b244ab278b9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:51.029887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a42b33de-4a97-46f0-a39a-0b244ab278b9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:51.030703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a42b33de-4a97-46f0-a39a-0b244ab278b9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:51.111230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a42b33de-4a97-46f0-a39a-0b244ab278b9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Going to try to start instance {{(pid=122815) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 13:38:51.170637 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a42b33de-4a97-46f0-a39a-0b244ab278b9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 202 len: 0 microversion: 2.1 time: 0.162687 Nov 19 13:38:51.171638 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 252/504] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:51 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:38:51.191068 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:51.191957 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:51.199733 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:51.201215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:51.202905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:51.203677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:51.216530 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:51.227695 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c2da30e8-41ab-444f-a99f-ea546da30544 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1512 microversion: 2.1 time: 0.245563 Nov 19 13:38:51.228584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 253/505] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:50 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:51.403030 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:51.412205 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b4e0dad0-3755-46c2-b3f5-b598cd798096 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1709 microversion: 2.1 time: 0.226402 Nov 19 13:38:51.415151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 253/506] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:51 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1709 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:52.024385 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:52.026036 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:52.034190 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.034931 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.037110 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.039403 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.235280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:52.245572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:52.247618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:52.248422 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:52.249422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:52.251228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d90b53fb-b44e-4190-8917-7ee1bc4ae4d8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.231421 Nov 19 13:38:52.252930 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 254/507] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:52 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:52.257220 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.257725 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.258546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.259006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.431690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:52.433759 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:52.447120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.448155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.450562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.451120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.560603 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:52.574707 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8fe93a0c-d457-4b2c-9405-dd2a69625a13 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1512 microversion: 2.1 time: 0.331840 Nov 19 13:38:52.575699 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 254/508] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:52 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:52.628165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-6012e272-3936-44b9-b450-c07332f7ee90 req-e6eb4f4d-90ef-486f-8ad3-52c364ada9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb3c92d-538c-4b70-b52f-345065c501a6", "name": "network-vif-deleted", "tag": "7b476506-aeb7-452f-b36d-cd93461bf7a9"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:52.629884 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:38:52.629884 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:38:52.637742 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-6012e272-3936-44b9-b450-c07332f7ee90 req-e6eb4f4d-90ef-486f-8ad3-52c364ada9bc service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:52.638510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-6012e272-3936-44b9-b450-c07332f7ee90 req-e6eb4f4d-90ef-486f-8ad3-52c364ada9bc service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:52.653654 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-6012e272-3936-44b9-b450-c07332f7ee90 req-e6eb4f4d-90ef-486f-8ad3-52c364ada9bc service nova] Creating event network-vif-deleted:7b476506-aeb7-452f-b36d-cd93461bf7a9 for instance 9bb3c92d-538c-4b70-b52f-345065c501a6 on hv-cinder-81735 Nov 19 13:38:52.655931 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:52.659152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-6012e272-3936-44b9-b450-c07332f7ee90 req-e6eb4f4d-90ef-486f-8ad3-52c364ada9bc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036254 Nov 19 13:38:52.659959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 255/509] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:38:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:38:52.665801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cfc17235-4aae-412c-915f-b5dd070f9951 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1709 microversion: 2.1 time: 0.239491 Nov 19 13:38:52.667239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 255/510] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:52 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1709 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:53.272053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:53.273471 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:53.280559 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:53.281003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:53.282032 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:53.283846 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:53.447690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:53.460554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:53.462084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:53.463288 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8c4ce54c-dfb2-4956-bd51-8b7fda8f395d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.196144 Nov 19 13:38:53.463927 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 256/511] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:53 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:53.593799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:53.594548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:53.601513 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:53.602297 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:53.603381 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:53.604106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:53.672543 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:53.681459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-26ebb04a-37c6-4506-bc0d-47d9774af99b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1470 microversion: 2.1 time: 0.092374 Nov 19 13:38:53.682065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 256/512] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:53 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:53.695458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:53.696452 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:53.703013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:53.704192 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:53.705260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:53.705892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:53.859387 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:53.871232 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-761eb3ce-4556-4a71-b558-e7067f904495 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1709 microversion: 2.1 time: 0.188408 Nov 19 13:38:53.871232 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 257/513] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:53 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:54.483689 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:54.484394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:54.490692 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:54.491174 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:54.492186 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:54.492652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:54.665031 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:54.674379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:54.676876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:54.678293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-77aff26b-a2ec-4f38-a9cc-9831d0fc47b7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.200344 Nov 19 13:38:54.689933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 257/514] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:54 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:54.702278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:54.703822 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:54.713760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:54.714444 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:54.719444 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:54.720196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:54.785966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:54.794593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8419bb9e-6a36-4f53-b173-91df15977d8f tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1470 microversion: 2.1 time: 0.096956 Nov 19 13:38:54.806704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 258/515] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:54 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:54.893998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:54.894971 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:54.902120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:54.902649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:54.903521 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:54.904160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:55.095489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:55.107269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a73d3c9f-12d6-4866-b0b1-9bac1ebcb181 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1709 microversion: 2.1 time: 0.217119 Nov 19 13:38:55.116586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 258/516] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:54 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1709 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:55.697102 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:55.697747 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:55.704932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:55.706169 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:55.707236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:55.707827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:55.817774 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:55.819323 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:55.837216 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:55.838120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:55.839313 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:55.840224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:55.928170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:55.933028 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:55.935778 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid 9bb3c92d-538c-4b70-b52f-345065c501a6 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:38:55.949568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:55.983666 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:55.986889 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:55.989132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7ed3fdbd-6fe1-4152-9b49-3327490f22fe tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.296366 Nov 19 13:38:56.002172 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:56.002465 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 259/517] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:55 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:56.013484 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5f36559b-3f90-42a2-bfb5-c259a705d2c5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 200 len: 1307 microversion: 2.1 time: 0.202279 Nov 19 13:38:56.014316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 259/518] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:55 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:56.128664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:56.129500 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:56.138463 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.138667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.139687 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.145871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.253775 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:56.256714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:56.274168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.280480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.291996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.291996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.327588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lazy-loading 'flavor' on Instance uuid a4794168-fa1e-43da-a27c-e5e83054dd1e {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:38:56.349643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:56.384091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d17cce83-8747-4021-ba8a-4a7e8018a7e2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1709 microversion: 2.1 time: 0.261352 Nov 19 13:38:56.384994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 260/519] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:56 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1709 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:38:56.391114 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6502185b-4285-4104-89b7-d57bf1e3bd1c", "device": "/dev/sdb"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:38:56.392911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:56.400973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.401420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.402215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.402645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.507136 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3946b99b-dcd4-48cf-90d8-7711fbd270e9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action" status: 200 len: 32 microversion: 2.1 time: 0.259697 Nov 19 13:38:56.508030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 260/520] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:38:56 2021] POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:38:56.522383 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:56.523269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:56.533673 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.534113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.534998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:56.535868 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:56.836816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:56.859060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e751d27e-185f-411e-bfae-2d90cfdfcfa0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.343547 Nov 19 13:38:56.861414 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 261/521] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:56 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:56.878010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6e443934-ffca-4da0-8be9-f541d9c6f7d4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "POST /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489911 Nov 19 13:38:56.883852 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 261/522] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:38:56 2021] POST /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:38:57.010274 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:57.011444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:57.033621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:57.035321 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9bb3c92d-538c-4b70-b52f-345065c501a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:57.048285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.050374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.051043 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.051738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.054046 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.054212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.055261 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.055408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.081798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] HTTP exception thrown: Instance 9bb3c92d-538c-4b70-b52f-345065c501a6 could not be found. Nov 19 13:38:57.084358 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Returning 404 to user: Instance 9bb3c92d-538c-4b70-b52f-345065c501a6 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:38:57.086544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-70c00345-1532-4a0e-a9b4-44c921c214bb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6" status: 404 len: 111 microversion: 2.1 time: 0.058900 Nov 19 13:38:57.087152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 262/523] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:57 2021] GET /compute/v2.1/servers/9bb3c92d-538c-4b70-b52f-345065c501a6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 13:38:57.324916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:57.345339 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:57.347792 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:57.349375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9307736f-f336-4493-b953-965e104af2a1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.343938 Nov 19 13:38:57.370846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 262/524] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:57 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:57.403212 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:57.403846 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:57.412736 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.413490 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.414447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.415037 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.605560 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:57.617345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2ae2b5f0-63df-4305-b0c5-625c3ce5074c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1713 microversion: 2.1 time: 0.217456 Nov 19 13:38:57.629036 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 263/525] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:57 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1713 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:57.891013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:57.891013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:57.904554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.904554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:57.904554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:57.904554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.148987 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:58.160977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1db5c869-40d2-4574-ad39-d516edc5da8c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.275304 Nov 19 13:38:58.162294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 263/526] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:57 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:58.311772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:58.312749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:58.324798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:58.326114 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.327423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:58.328107 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.371125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:58.371933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:58.383066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:38:58.396675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:58.400916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.404122 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:58.407012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.554384 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8ff311a0-e843-43b0-8453-c55fc6bd7849 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 204 len: 0 microversion: 2.1 time: 0.245847 Nov 19 13:38:58.558085 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 264/527] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:38:58 2021] DELETE /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:38:58.570884 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:58.571670 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:58.578704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:58.579533 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.580536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:58.580963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:58.711960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:58.721204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:58.723114 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:58.724901 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1339590b-2bed-405a-a85b-1b1a095d855e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.359473 Nov 19 13:38:58.738990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 264/528] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:58 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:38:58.807438 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:58.819967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-94915409-9218-4f39-8660-c9b6466dd24b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1512 microversion: 2.1 time: 0.255392 Nov 19 13:38:58.820789 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 265/529] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:58 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:59.180037 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:59.180661 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:59.188335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:59.188794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:59.189605 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:59.190038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:59.361252 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:38:59.370302 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-60f68d52-a3cb-45e2-aacd-2e476270ea5e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.194839 Nov 19 13:38:59.371152 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 265/530] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:59 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:38:59.746691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:59.748219 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:59.769327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:59.771138 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:59.772690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:59.773667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:59.838745 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:38:59.839404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:38:59.848307 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:59.855396 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:38:59.856437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:38:59.857053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:00.130934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:00.145664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:00.157485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:00.159032 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-951bb840-b294-40ff-bacc-f36699af9fcd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.416907 Nov 19 13:39:00.160123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 266/531] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:38:59 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:00.230574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:00.241742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-32211e9d-cc56-48d1-8680-1ca6dce449d2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1512 microversion: 2.1 time: 0.407712 Nov 19 13:39:00.246507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 266/532] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:38:59 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:00.391954 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:00.392780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:00.401147 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:00.401778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:00.402840 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:00.403402 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:00.709911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:00.731416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1fac3707-cfde-4d63-9373-ea3098ff92e6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.342712 Nov 19 13:39:00.735474 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 267/533] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:00 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:01.177535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:01.178050 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:01.184774 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.185225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.186011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.186594 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.265366 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:01.266196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:01.279961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.280501 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.281613 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.282050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.565286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:01.604658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:01.607155 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:01.611394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:01.616788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7c508cff-68fc-42b9-8011-8999050604a7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 200 len: 1512 microversion: 2.1 time: 0.356560 Nov 19 13:39:01.616908 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-98f0fde0-6a1e-4477-86ee-d808db86be97 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.439404 Nov 19 13:39:01.626577 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 267/534] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:01 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:01.628509 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 268/535] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:01 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:01.657651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-7cf5e120-8b05-4c9a-b468-32072649620e req-733e095a-be20-4363-8861-5827de2d4bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956eae6f-3a6a-4db9-97f6-d6b89d4727ac", "name": "network-vif-deleted", "tag": "4ecd3cb2-7e39-4c27-babb-37b69833287a"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:01.659349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:01.659349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:01.674969 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-7cf5e120-8b05-4c9a-b468-32072649620e req-733e095a-be20-4363-8861-5827de2d4bb9 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.675450 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-7cf5e120-8b05-4c9a-b468-32072649620e req-733e095a-be20-4363-8861-5827de2d4bb9 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.691684 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-7cf5e120-8b05-4c9a-b468-32072649620e req-733e095a-be20-4363-8861-5827de2d4bb9 service nova] Creating event network-vif-deleted:4ecd3cb2-7e39-4c27-babb-37b69833287a for instance 956eae6f-3a6a-4db9-97f6-d6b89d4727ac on hv-cinder-81735 Nov 19 13:39:01.697792 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-7cf5e120-8b05-4c9a-b468-32072649620e req-733e095a-be20-4363-8861-5827de2d4bb9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044082 Nov 19 13:39:01.698934 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 268/536] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:01.753974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:01.754768 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:01.766175 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.766634 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.773211 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:01.776912 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:01.955262 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:01.964610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-75722a7c-1372-415b-a948-3e9bf8ac2ead tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.214887 Nov 19 13:39:01.965592 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 269/537] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:01 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:02.636918 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:02.637668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 956eae6f-3a6a-4db9-97f6-d6b89d4727ac] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:02.638023 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:02.638702 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:02.648964 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.649292 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.650125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.650607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.651285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.652480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.653698 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.654692 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.682075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] HTTP exception thrown: Instance 956eae6f-3a6a-4db9-97f6-d6b89d4727ac could not be found. Nov 19 13:39:02.682953 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Returning 404 to user: Instance 956eae6f-3a6a-4db9-97f6-d6b89d4727ac could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:02.684025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-22203b6c-5cde-4761-8f56-52549aa8f3b4 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac" status: 404 len: 111 microversion: 2.1 time: 0.052161 Nov 19 13:39:02.685729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 269/538] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:02 2021] GET /compute/v2.1/servers/956eae6f-3a6a-4db9-97f6-d6b89d4727ac => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:39:02.697976 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:02.698823 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:02.721552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.724544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.724544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.724544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.757688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:02.857694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bf34f13d-80e5-425a-a081-4b035c6e5915 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 204 len: 0 microversion: 2.1 time: 0.166413 Nov 19 13:39:02.859327 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 270/539] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:02 2021] DELETE /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:02.874220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:02.875668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:02.892989 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.893945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.894605 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.894845 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.914216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:02.925387 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:02.927383 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:02.928931 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fabfee6c-0ddc-4ed7-96ed-d5929ae3f037 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1738 microversion: 2.20 time: 0.297100 Nov 19 13:39:02.930018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 270/540] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:02 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:02.984022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:02.985171 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:02.995717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:02.997316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:02.999391 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:03.000499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:03.109898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:03.119301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-12ec4836-c5f4-4d68-a219-27bf9cd4c0f5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1512 microversion: 2.1 time: 0.253516 Nov 19 13:39:03.129038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 271/541] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:02 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:03.210237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:03.219461 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ce31ed9d-74e9-4b04-8f5e-dcc063af60c5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.241240 Nov 19 13:39:03.220978 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 271/542] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:02 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:03.948879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:03.949487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:03.956625 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:03.957264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:03.958130 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:03.958650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:04.099014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:04.107835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:04.109926 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:04.111269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-910af827-a858-4db9-ac6f-3d911a6b00ae tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1720 microversion: 2.20 time: 0.166150 Nov 19 13:39:04.111909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 272/543] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:03 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:04.137038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:04.137629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:04.144532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:04.144992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:04.145841 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:04.146308 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:04.236722 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:04.237335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:04.244517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:04.245522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:04.247235 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:04.247992 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:04.301854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:04.310749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-84a4705b-1034-4986-ae1f-cab9bb9bb627 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1512 microversion: 2.1 time: 0.177454 Nov 19 13:39:04.311434 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 272/544] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:04 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:04.393068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:04.401240 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fcc6bf98-2215-4017-9d54-ff6ba6715b48 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.168283 Nov 19 13:39:04.401824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 273/545] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:04 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:04.709230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1859211507", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "a9ae6f60-90f0-4ba8-9236-d97d59dc896f"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:04.762165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] validate_networks() for [('a9ae6f60-90f0-4ba8-9236-d97d59dc896f', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:39:05.132169 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:05.132555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:39:05.132665 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:05.133742 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:39:05.133742 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:39:05.134267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:39:05.134786 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:39:05.145375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.145816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.146929 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.147032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.150523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.150954 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.151846 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.152287 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.169529 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Getting quotas for project ae645dfd25a84e94ab2e84a62ce1826e. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:39:05.174193 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Getting quotas for user 717543a064f44f75b48734a031c0571a and project ae645dfd25a84e94ab2e84a62ce1826e. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:39:05.186560 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:39:05.189086 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:39:05.244420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cbf43f33-2770-4aee-87a9-92b99119e180 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538799 Nov 19 13:39:05.246326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 273/546] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:39:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:39:05.256876 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b8c3de8c-a606-45ed-b7c2-ba5f5986c7ff tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:05.257883 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b8c3de8c-a606-45ed-b7c2-ba5f5986c7ff tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:05.304948 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:05.316409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:05.320128 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b8c3de8c-a606-45ed-b7c2-ba5f5986c7ff tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:05.321021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:05.323032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7f5f4ab7-10d0-4ebd-829e-0f6f9b936213 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1720 microversion: 2.20 time: 0.195889 Nov 19 13:39:05.323961 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 274/547] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:05 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:05.328891 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b8c3de8c-a606-45ed-b7c2-ba5f5986c7ff tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1214 microversion: 2.1 time: 0.077263 Nov 19 13:39:05.329577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 274/548] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:05 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:05.329721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:05.330181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:05.338840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.339562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.340524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.340981 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.417633 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:05.418455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:05.427870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.428696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.429647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.430242 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.544047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:05.555339 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2f50afb1-dcb1-40a4-ba94-478bf32268b2 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1512 microversion: 2.1 time: 0.229177 Nov 19 13:39:05.556169 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 275/549] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:05 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:05.626758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:05.635068 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5b14ed68-24f4-4d23-8fe7-742da457f8f6 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.221121 Nov 19 13:39:05.636107 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 275/550] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:05 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:05.655831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-da79ac6b-d580-46c7-8ea1-bf30710dc007 req-9956efec-a57e-4dd6-972a-1b5311b36466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc664a9-a9d4-4827-9bb5-94c81531a0e5", "name": "network-vif-deleted", "tag": "b5edbcfa-b003-4f23-9e31-e4f781f893f8"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:05.657792 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:05.657792 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:05.665384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-da79ac6b-d580-46c7-8ea1-bf30710dc007 req-9956efec-a57e-4dd6-972a-1b5311b36466 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:05.665828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-da79ac6b-d580-46c7-8ea1-bf30710dc007 req-9956efec-a57e-4dd6-972a-1b5311b36466 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:05.678533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-da79ac6b-d580-46c7-8ea1-bf30710dc007 req-9956efec-a57e-4dd6-972a-1b5311b36466 service nova] Creating event network-vif-deleted:b5edbcfa-b003-4f23-9e31-e4f781f893f8 for instance 9dc664a9-a9d4-4827-9bb5-94c81531a0e5 on hv-cinder-81735 Nov 19 13:39:05.683645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-da79ac6b-d580-46c7-8ea1-bf30710dc007 req-9956efec-a57e-4dd6-972a-1b5311b36466 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Nov 19 13:39:05.684244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 276/551] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:39:06.341943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:06.342597 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:06.349029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:06.349730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:06.349866 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.350213 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.350992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.351476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.356126 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.356577 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.357361 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.357827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.435354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:06.443178 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9b76f004-9084-4a4a-9fe7-fc6cf5690cab tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1218 microversion: 2.1 time: 0.098916 Nov 19 13:39:06.443767 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 277/552] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:06 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:06.506213 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:06.514396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:06.515973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:06.517212 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f039c70b-d5d5-43af-8ff5-1188df5aa169 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1720 microversion: 2.20 time: 0.179068 Nov 19 13:39:06.517766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 276/553] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:06 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:06.574024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:06.574944 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:06.581373 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.581831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.582621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.583058 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.646588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:06.652531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:06.653228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:06.654539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ed5ca475-d921-4007-b0a6-f17d676f9449 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1302 microversion: 2.1 time: 0.084535 Nov 19 13:39:06.655192 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 278/554] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:06 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:06.660444 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.660913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.661908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:06.662353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:06.801619 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:06.812198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6e930934-83b8-4259-8332-8c19bbc33852 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.163261 Nov 19 13:39:06.812802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 277/555] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:06 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:07.460496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:07.461099 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:07.469012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.469458 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.470252 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.470692 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.531343 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:07.536457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:07.537194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:07.539117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6f21ec8a-bbef-4e14-9e7b-d443b10698dc tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1218 microversion: 2.1 time: 0.082424 Nov 19 13:39:07.539718 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 279/556] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:07 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:07.544332 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.544889 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.545913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.546420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.671919 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:07.672424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:07.678903 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.679388 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.680186 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.680618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.687676 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:07.696397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:07.697913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:07.699121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7c2252d1-400a-44d7-8251-fe5a6d51a308 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1720 microversion: 2.20 time: 0.166553 Nov 19 13:39:07.699696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 278/557] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:07 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:07.742632 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:07.750587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9a31bdc3-0f4d-46de-8932-a1c4e7ad2579 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 200 len: 1302 microversion: 2.1 time: 0.082940 Nov 19 13:39:07.751183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 280/558] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:07 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:07.829435 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:07.830078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:07.840716 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.841145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.842042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:07.842545 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:07.993656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:08.004258 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-623e1b01-9baf-4f7b-8bc6-4f9ee2c02f8b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.178403 Nov 19 13:39:08.005195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 279/559] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:07 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:08.196081 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-39d99eca-186f-4fcb-8e70-f567073978b3 req-d71a6d42-d78a-4596-9cf9-5ec54d7dcafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "name": "network-vif-unplugged", "status": "completed", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:08.197944 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:08.197944 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:08.205328 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-39d99eca-186f-4fcb-8e70-f567073978b3 req-d71a6d42-d78a-4596-9cf9-5ec54d7dcafc service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.205822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-39d99eca-186f-4fcb-8e70-f567073978b3 req-d71a6d42-d78a-4596-9cf9-5ec54d7dcafc service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.218757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-39d99eca-186f-4fcb-8e70-f567073978b3 req-d71a6d42-d78a-4596-9cf9-5ec54d7dcafc service nova] Creating event network-vif-unplugged:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:39:08.225058 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-39d99eca-186f-4fcb-8e70-f567073978b3 req-d71a6d42-d78a-4596-9cf9-5ec54d7dcafc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032595 Nov 19 13:39:08.225892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 281/560] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:08.559122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:08.560208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:08.566981 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.567478 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.568270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.568905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.634689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:08.642909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0f446366-55f6-4115-87fd-04636b0b7026 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1266 microversion: 2.1 time: 0.087551 Nov 19 13:39:08.643536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 280/561] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:08 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:08.720111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:08.720900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:08.728620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.729063 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.730202 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.730636 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.770582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:08.771610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: 9dc664a9-a9d4-4827-9bb5-94c81531a0e5] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:08.778038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.778759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.779825 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:08.780745 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:08.797053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] HTTP exception thrown: Instance 9dc664a9-a9d4-4827-9bb5-94c81531a0e5 could not be found. Nov 19 13:39:08.797922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Returning 404 to user: Instance 9dc664a9-a9d4-4827-9bb5-94c81531a0e5 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:08.798947 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-43f5c48b-eb05-4b77-a9a5-c161f0b98701 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5" status: 404 len: 111 microversion: 2.1 time: 0.034582 Nov 19 13:39:08.799771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 281/562] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:08 2021] GET /compute/v2.1/servers/9dc664a9-a9d4-4827-9bb5-94c81531a0e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 13:39:08.895045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:08.904794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:08.906548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:08.908140 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8d63646e-726e-4bd6-b3ee-8b9b7314b07d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1720 microversion: 2.20 time: 0.193463 Nov 19 13:39:08.908708 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 282/563] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:08 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:09.021051 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:09.021773 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:09.028740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.029191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.030073 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.030770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.247383 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:09.257234 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a02b7081-53b3-4d85-be81-8b637e0d103b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.240119 Nov 19 13:39:09.258145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 282/564] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:09 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:09.660773 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:09.661404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:09.667901 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.668346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.669293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.669776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.812016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:09.822778 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-35a5a102-abe6-4d6d-85c4-76dd14c215ad tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.165596 Nov 19 13:39:09.823443 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 283/565] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:09 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:09.926905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:09.927710 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:09.934808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.935363 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.936149 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.936567 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.948203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:09.948725 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:09.955131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.955583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.956377 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:09.956812 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:09.985722 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:10.070671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3b9c51c1-a951-4d0c-a693-d5eff88a9153 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "DELETE /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 204 len: 0 microversion: 2.1 time: 0.126014 Nov 19 13:39:10.074386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 284/566] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:09 2021] DELETE /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:10.075811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.079816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:10.080384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:10.084520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.086004 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.086449 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.086905 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.087165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-50e2a9d8-01f0-4a66-8b8b-33d22ebf1e7f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1663 microversion: 2.20 time: 0.164104 Nov 19 13:39:10.087734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.087871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 283/567] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:09 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:10.088232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.104677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092e45cd-b690-4b85-84eb-a2a63b121428"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:10.105791 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:10.112036 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.112479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.113270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.113701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.232342 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.244645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6c872cf0-c981-4948-ad89-14a628f3155d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.168848 Nov 19 13:39:10.245251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 285/568] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:10 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:10.274062 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:10.274904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:10.281784 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.282348 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.283253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.283733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.407592 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-167acc6d-56a2-4760-a7c0-e8159848c64c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306440 Nov 19 13:39:10.408349 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 284/569] 10.222.0.74 () {62 vars in 1363 bytes} [Fri Nov 19 13:39:10 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:39:10.435498 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.443870 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-722e6b8b-a030-4b42-8bae-e109c0b42148 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.173554 Nov 19 13:39:10.444422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 286/570] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:10 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:10.519500 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:10.520072 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:10.527210 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.527664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.528462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.528876 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.630401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f332bbd4-ba29-48bc-a2fd-ccd230ec1e95 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action" status: 202 len: 0 microversion: 2.20 time: 0.114706 Nov 19 13:39:10.631316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 285/571] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:39:10 2021] POST /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:10.641090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:10.641744 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:10.647806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.648263 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.649097 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.649573 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.788947 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.797615 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.799084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.800280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b2cb1aa9-f86f-4270-89e0-d2072834be6f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1749 microversion: 2.20 time: 0.163290 Nov 19 13:39:10.800942 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 287/572] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:10 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:10.841151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:10.841797 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:10.848194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.848648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.849431 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:10.849890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:10.987577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:10.995112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-897c7ee2-b07e-49e2-9bfc-3c2a81046002 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.157648 Nov 19 13:39:10.995704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 286/573] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:10 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:11.261642 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:11.262129 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:11.270446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:11.271285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:11.272259 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:11.272698 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:11.412070 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:11.420075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0d27f594-f44d-49a1-8f66-79c3f23eabb5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.162156 Nov 19 13:39:11.420783 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 288/574] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:11 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:11.462392 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:11.463060 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:11.470042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:11.470502 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:11.471343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:11.471786 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:11.613179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:11.621489 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9133a1ea-e8c0-472e-b341-54a5fa4a442f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.164014 Nov 19 13:39:11.622122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 287/575] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:11 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:11.819420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:11.820026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:11.826842 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:11.827334 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:11.828384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:11.828524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:11.964659 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:11.975206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:11.976857 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:11.978045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b5f54aff-1629-42fc-9c10-57463b6df600 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1749 microversion: 2.20 time: 0.162610 Nov 19 13:39:11.978597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 289/576] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:11 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:12.013673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:12.014437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:12.021402 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:12.021854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:12.022693 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:12.023151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:12.178922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:12.188320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2070eccd-dbf4-41db-a72d-c4a2a0fee302 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.179889 Nov 19 13:39:12.188924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 288/577] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:12 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:12.438089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:12.438688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:12.445273 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:12.445776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:12.446634 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:12.447335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:12.640640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:12.651337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:12.663653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:12.671271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:12.671741 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:12.672559 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:12.673176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:12.674557 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-91d5b717-a97a-48a5-825d-2cf091dd395d tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.240855 Nov 19 13:39:12.675488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 290/578] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:12 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:12.897365 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:12.905520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-21c32463-f01c-418c-a061-92d238331322 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.270072 Nov 19 13:39:12.906101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 289/579] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:12 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:12.996569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:12.997124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:13.004386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.004844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.005680 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.006114 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.208440 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:13.209838 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:13.218368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.219287 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.220375 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.220964 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.457175 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:13.476753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:13.478951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:13.480403 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6cc5a8ea-96aa-4f41-bf90-c9fde0d82c62 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1751 microversion: 2.20 time: 0.487774 Nov 19 13:39:13.481021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 291/580] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:12 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1751 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:13.534875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:13.554616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-58f39172-0d4e-4966-b097-62ada2f47534 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.348677 Nov 19 13:39:13.556790 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 290/581] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:13 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:13.693959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:13.694848 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:13.701489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.702808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.703641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.704092 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.857304 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:13.869537 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-72cb6d9d-ba9b-47ee-b906-70a61a0929eb tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.179923 Nov 19 13:39:13.871993 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 292/582] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:13 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:13.876815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-c202487b-448b-46aa-8af1-9f9a218a33b5 req-9c653920-a24e-4355-9f56-a79048a3d475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8d33b7-76b2-4041-ab20-d4a74eea2d27", "tag": "b26c8698-00fd-4150-8e38-3ba244b790a3"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:13.880132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:13.880132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:13.893005 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-c202487b-448b-46aa-8af1-9f9a218a33b5 req-9c653920-a24e-4355-9f56-a79048a3d475 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.894011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-c202487b-448b-46aa-8af1-9f9a218a33b5 req-9c653920-a24e-4355-9f56-a79048a3d475 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.905579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-c202487b-448b-46aa-8af1-9f9a218a33b5 req-9c653920-a24e-4355-9f56-a79048a3d475 service nova] Creating event network-changed:b26c8698-00fd-4150-8e38-3ba244b790a3 for instance 4a8d33b7-76b2-4041-ab20-d4a74eea2d27 on hv-cinder-81735 Nov 19 13:39:13.911874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-c202487b-448b-46aa-8af1-9f9a218a33b5 req-9c653920-a24e-4355-9f56-a79048a3d475 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041644 Nov 19 13:39:13.912720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 291/583] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:13.922133 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:13.922747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:13.929338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.929775 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:13.930815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:13.931281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:14.075453 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:14.084940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4d181763-f806-4c80-99f6-3a6ae875abc7 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.166737 Nov 19 13:39:14.085536 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 293/584] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:13 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:14.502253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:14.502929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:14.509889 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:14.510337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:14.511161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:14.511595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:14.573837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:14.574434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:14.580822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:14.581286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:14.582127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:14.582557 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:14.694148 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:14.703120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:14.704629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:14.705794 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cc7718e2-2d60-410e-8e4a-6fb103de78d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.209370 Nov 19 13:39:14.706381 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 292/585] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:14 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:14.760150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:14.769690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-762471c8-b228-480d-8209-0b5c4308453a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.199414 Nov 19 13:39:14.770321 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 294/586] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:14 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:14.887701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:14.888226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:14.895790 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:14.896237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:14.897026 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:14.897458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.034148 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:15.042182 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3b896ed2-f036-4b72-810d-0422acf81708 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.158337 Nov 19 13:39:15.042726 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 293/587] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:14 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:15.103928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:15.104539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:15.111440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:15.111891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.112686 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:15.113150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.264364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:15.273179 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8805ea3a-b2f3-4139-84be-29c7320b2cfc tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.173048 Nov 19 13:39:15.273891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 295/588] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:15 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:15.724817 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:15.725422 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:15.732133 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:15.732582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.733388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:15.733818 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.788249 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:15.789017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:15.796451 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:15.797453 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.798209 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:15.798752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:15.906068 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:15.916286 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:15.918174 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:15.919628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-27f84690-1109-4a47-b264-410ebe133912 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.198600 Nov 19 13:39:15.920195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 294/589] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:15 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:15.980500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:15.990755 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8a3f31ae-2a30-4e51-9322-75aa4729447e tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.208168 Nov 19 13:39:15.991360 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 296/590] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:15 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:16.060892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:16.061498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:16.068272 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:16.068726 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:16.069514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:16.069948 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:16.204451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:16.212688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-032b818e-2f20-44a2-8dc3-09ee56b9b91e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.156390 Nov 19 13:39:16.213249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 295/591] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:16 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:16.290462 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:16.291142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:16.298021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:16.298490 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:16.299445 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:16.299906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:16.444084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:16.452729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-60e44d4a-0d25-4f33-ab06-a69beb12bf91 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.166117 Nov 19 13:39:16.453232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 297/592] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:16 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:16.939422 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:16.940123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:16.946924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:16.947406 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:16.948200 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:16.948634 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.009755 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:17.011312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:17.017616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:17.018063 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.019082 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:17.020374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.118210 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:17.126868 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:17.128858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:17.130061 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-239905bc-d1f4-4064-a56a-6ee702656ecc tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.195191 Nov 19 13:39:17.130638 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 296/593] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:16 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:17.185645 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:17.193606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2610df27-5f82-4926-b302-1e067a1e713c tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.189039 Nov 19 13:39:17.194252 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 298/594] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:17 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:17.230969 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:17.231654 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:17.240227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:17.240734 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.241793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:17.242338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.391188 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:17.399226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4031990d-3f02-487b-9ed8-804e35d8d1e9 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1514 microversion: 2.1 time: 0.173021 Nov 19 13:39:17.402367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 297/595] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:17 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:17.470826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:17.471596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:17.477729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:17.478262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.479067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:17.479529 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:17.627899 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:17.637771 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-46b728f7-3a5e-46fb-ae51-f3d1ff229f97 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.171558 Nov 19 13:39:17.638368 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 299/596] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:17 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:18.148577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:18.149254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:18.156274 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.156727 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.157520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.157988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.209700 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:18.210332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:18.216480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.217352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.218132 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.218629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.388300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:18.397668 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:18.399308 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:18.400987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-555bda86-ca20-49c3-a41e-1aa0f9242ad9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.256335 Nov 19 13:39:18.401908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 298/597] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:18 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:18.418509 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:18.419206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:18.426431 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.427120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.428054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.428622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.545868 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:18.555486 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b7f0b825-118b-40e3-9303-ac75d3a80d89 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1472 microversion: 2.1 time: 0.141104 Nov 19 13:39:18.556608 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 299/598] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:18 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1472 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:18.574828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:18.581089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-34d7eb91-f82c-4f8c-b5cd-68a600052da0 req-09c4cab2-0a96-4760-a387-7cad49bd8d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0e9fcb-022c-4369-8d5e-b644024f55aa", "name": "network-vif-deleted", "tag": "14ba1da9-a1bd-4d76-a1b8-660a0f7015d0"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:18.582721 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:18.582721 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:18.586826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bc943d61-93ce-43c3-a189-ab25e1f5f0c1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.380896 Nov 19 13:39:18.588400 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 300/599] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:18 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:18.590664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-34d7eb91-f82c-4f8c-b5cd-68a600052da0 req-09c4cab2-0a96-4760-a387-7cad49bd8d88 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.591137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-34d7eb91-f82c-4f8c-b5cd-68a600052da0 req-09c4cab2-0a96-4760-a387-7cad49bd8d88 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.609661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-34d7eb91-f82c-4f8c-b5cd-68a600052da0 req-09c4cab2-0a96-4760-a387-7cad49bd8d88 service nova] Creating event network-vif-deleted:14ba1da9-a1bd-4d76-a1b8-660a0f7015d0 for instance df0e9fcb-022c-4369-8d5e-b644024f55aa on hv-cinder-81735 Nov 19 13:39:18.615137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-34d7eb91-f82c-4f8c-b5cd-68a600052da0 req-09c4cab2-0a96-4760-a387-7cad49bd8d88 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048053 Nov 19 13:39:18.615695 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 300/600] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:18.660004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:18.661032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:18.667590 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.668047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.669811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:18.669811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:18.852272 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:18.864608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2496da93-bf11-468d-b465-a69e4d7dc8a0 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.212191 Nov 19 13:39:18.874182 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 301/601] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:18 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:19.420988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:19.421687 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:19.428515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.428973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.429771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.430396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.577139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:19.577909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:19.584740 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.589641 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:19.590004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.590983 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.591540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.601245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:19.603041 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:19.604332 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-78448c8b-14e7-403c-adf5-b9235884a738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.188033 Nov 19 13:39:19.604942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 301/602] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:19 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:19.609324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:19.609947 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:19.616411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.616783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.617570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.618000 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.627425 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.627877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.628325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:19.679384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:19.687171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-102ce073-fa16-443b-b369-de52704859ea tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.114475 Nov 19 13:39:19.687752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 302/603] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:19 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:19.771070 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:19.778724 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0fec38eb-6bd0-4a3d-b5f2-32a582d711c8 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.172149 Nov 19 13:39:19.778724 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 302/604] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:19 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:19.882541 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:19.883286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:19.889849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.890564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:19.891392 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:19.891819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.049867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:20.063408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d369d9aa-cfaf-49b8-81d6-02a764938d2c tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.185142 Nov 19 13:39:20.064421 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 303/605] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:19 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:20.624562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:20.625468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:20.636177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.637181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.638292 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.638856 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.705174 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:20.705750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:20.718233 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.718812 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.719726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.720211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.756796 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.757358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.757918 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:20.812174 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:20.817430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:20.820183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1cc1562a-56c0-4722-b8dd-5c5ff55e47e5 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.118981 Nov 19 13:39:20.820776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 304/606] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:20 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:20.827294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:20.827294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:20.827498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:20.828722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:20.829984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e83b0dca-0512-4538-b77b-508d9017b25e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.210863 Nov 19 13:39:20.830622 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 303/607] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:20 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:20.831860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.832312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.833166 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:20.833736 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:20.988500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:20.996666 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-535c3780-9022-4f02-b270-0dff6e8e43be tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.174869 Nov 19 13:39:20.997245 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 305/608] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:20 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:21.081874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:21.082584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:21.089439 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.089895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.090686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.091322 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.153132 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:21.153803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:21.160133 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.160671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.161533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.162032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.245235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:21.252409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lazy-loading 'services' on Instance uuid f548133d-928a-4fa3-9c06-f70a614f54d6 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:21.253272 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f6cfde59-1b26-49ea-914f-58650bab08b9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.175285 Nov 19 13:39:21.253991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 304/609] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:21 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:21.330438 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6c8d9cd9-1e77-49b4-bb64-f33fb9fdd408 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6/os-volume_attachments/6502185b-4285-4104-89b7-d57bf1e3bd1c" status: 202 len: 0 microversion: 2.1 time: 0.180910 Nov 19 13:39:21.331027 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 306/610] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:39:21 2021] DELETE /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6/os-volume_attachments/6502185b-4285-4104-89b7-d57bf1e3bd1c => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:39:21.838333 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:21.838983 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:21.846604 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.847262 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.848181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.848733 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.850389 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:21.851200 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:21.868668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.869151 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.869945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.870370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.883779 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:21.884245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:21.884958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:21.974419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:21.985670 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1b113df3-6590-435d-a7b1-9046228a6529 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.151592 Nov 19 13:39:21.986900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 305/611] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:21 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:22.013235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:22.013843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:22.020758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:22.021208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:22.022012 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:22.022443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:22.076848 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:22.099626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:22.101584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:22.102846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-01e83c16-692f-4764-84be-6c95ec156b9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.257444 Nov 19 13:39:22.103826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 307/612] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:21 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:22.195837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:22.203601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-091cbe48-3578-4b41-b3ed-a6f6b07be443 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.194052 Nov 19 13:39:22.204182 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 306/613] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:22 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:22.269854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:22.270369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:22.276305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:22.276746 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:22.277518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:22.277945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:22.466563 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:22.477724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f88256db-5aef-4329-8915-48469c93c3f2 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.211718 Nov 19 13:39:22.478502 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 308/614] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:22 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:23.003219 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:23.005224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:23.014368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.014827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.015683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.016093 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.050931 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.051399 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.051854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:23.093512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:23.101356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4e97feda-36bb-4bc8-b4f9-0656d6c83227 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.101812 Nov 19 13:39:23.102217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 307/615] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:22 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:23.125340 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:23.125986 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:23.132664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.133131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.133920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.134367 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.223364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:23.224265 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:23.231837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.232744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.233877 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.234327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.295930 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:23.307282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:23.308759 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:23.310269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7e52807e-cf1c-4b6d-8d77-a6f538ba0c39 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.188752 Nov 19 13:39:23.310873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 309/616] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:23 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:23.403187 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:23.413456 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-64999fd0-a207-49de-b39c-a734eda88488 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.196480 Nov 19 13:39:23.414089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 308/617] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:23 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:23.496183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:23.497660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:23.504956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.505394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.506762 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.507591 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.723696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-7b8ad251-be20-428d-9ac4-576d400bb473 req-5725c02e-288a-46b6-9c0c-a3e238e4e950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8d33b7-76b2-4041-ab20-d4a74eea2d27", "name": "network-vif-plugged", "status": "completed", "tag": "b26c8698-00fd-4150-8e38-3ba244b790a3"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:23.725595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:23.725595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:23.736022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-7b8ad251-be20-428d-9ac4-576d400bb473 req-5725c02e-288a-46b6-9c0c-a3e238e4e950 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:23.736462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-7b8ad251-be20-428d-9ac4-576d400bb473 req-5725c02e-288a-46b6-9c0c-a3e238e4e950 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:23.755068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:23.756136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-7b8ad251-be20-428d-9ac4-576d400bb473 req-5725c02e-288a-46b6-9c0c-a3e238e4e950 service nova] Creating event network-vif-plugged:b26c8698-00fd-4150-8e38-3ba244b790a3 for instance 4a8d33b7-76b2-4041-ab20-d4a74eea2d27 on hv-cinder-81735 Nov 19 13:39:23.761645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-7b8ad251-be20-428d-9ac4-576d400bb473 req-5725c02e-288a-46b6-9c0c-a3e238e4e950 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051981 Nov 19 13:39:23.762823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 309/618] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:39:23.766001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-01da74d2-aff8-4abc-9f25-a1f4a76885a9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.274485 Nov 19 13:39:23.766597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 310/619] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:23 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:24.120937 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:24.121685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:24.128973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.129556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.130385 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.130794 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.166993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.167390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.167762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:24.212324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:24.220677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-be5f1d57-759c-4bf7-8699-0428b6f61fba tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.104658 Nov 19 13:39:24.221485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 310/620] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:24 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:24.329776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:24.330500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:24.337687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.338390 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.339375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.339948 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.430014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:24.430522 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:24.437296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.437732 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.438710 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.439013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.534561 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:24.543335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:24.544922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:24.546173 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cc7922e5-8bba-433d-aece-0e0516a790eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.220262 Nov 19 13:39:24.546855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 311/621] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:24 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:24.621503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:24.629277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-839bcf0a-e3ac-4518-b4d9-2e430faa34a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.203110 Nov 19 13:39:24.630208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 311/622] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:24 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:24.784772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:24.786137 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:24.794777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.795437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.796666 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:24.797267 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:24.959326 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:24.970267 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e49fe4b6-4ad6-4b12-b9a7-674c1259c503 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.190399 Nov 19 13:39:24.971281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 312/623] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:24 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:25.238331 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:25.238987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:25.246253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.246691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.247542 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.247971 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.283980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.284434 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.285102 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:25.332892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:25.340499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-10f6a8ff-9063-4e6a-b928-170d895a60c0 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.106057 Nov 19 13:39:25.341096 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 312/624] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:25 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:25.566488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:25.567338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:25.574234 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.574685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.575545 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.576004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.646652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:25.648749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:25.663767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.664379 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.665305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.666303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.785154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:25.795898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:25.797513 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:25.798597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e6d21631-ee4f-4131-ac12-524446fc33fb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.236348 Nov 19 13:39:25.799582 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 313/625] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:25 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:25.864123 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:25.872761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c72bd0d7-2e1c-46f1-81f2-33ec3fc8d4ee tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.230391 Nov 19 13:39:25.873673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 313/626] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:25 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:25.988523 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:25.989517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:25.995812 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.996243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:25.997283 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:25.997681 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.148211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:26.156783 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6b05b68b-361a-4aa9-8e10-7d160609ab54 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.172377 Nov 19 13:39:26.157352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 314/627] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:25 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:26.359271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:26.361176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:26.371150 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.371661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.372455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.372890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.405845 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.406212 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.406673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:26.450673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:26.458258 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-94c3c81f-e8e7-4f5e-ba6d-3e79aa777f3b tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.102796 Nov 19 13:39:26.458841 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 314/628] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:26 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:26.818011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:26.818621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:26.825251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.825973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.826771 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.827232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.893503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:26.894894 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:26.903018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.908347 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:26.908347 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:26.908347 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:27.014687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:27.024264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:27.025920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:27.027150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-22824974-5fd4-4a41-bc4d-b0c9c102da56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.213024 Nov 19 13:39:27.027747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 315/629] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:26 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:27.094754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:27.102886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ab0ed33f-679b-4fda-bc16-9b2e755522d1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.215506 Nov 19 13:39:27.103522 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 315/630] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:26 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:27.176564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:27.177510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:27.185994 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:27.186427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:27.187310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:27.187746 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:27.338635 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:27.347362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7a546d7f-6fc2-4a2f-a9a8-25e28bb03a78 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.176469 Nov 19 13:39:27.348059 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 316/631] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:27 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:27.477027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:27.477642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:27.485236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:27.485693 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:27.486531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:27.486935 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:27.521044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:27.521583 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:27.522047 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:27.575329 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:27.583723 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-42be3404-d240-4f32-ac14-124304c62ddd tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.111473 Nov 19 13:39:27.584497 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 316/632] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:27 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:28.046278 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:28.046899 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:28.054119 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.054560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.055705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.055826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.124095 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:28.125274 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:28.133129 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.133582 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.134397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.134827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.264306 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:28.276012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:28.277641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:28.278747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6312640d-ef4a-4703-8e16-9b9777ea7e5a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.236531 Nov 19 13:39:28.279430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 317/633] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:28 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:28.349995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:28.357581 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d2a8985d-6627-44f7-971a-89f7f0419bb0 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.239882 Nov 19 13:39:28.358587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 317/634] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:28 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:28.364690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:28.365317 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:28.373155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.373609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.374627 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.374914 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.536100 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:28.548211 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-057f33bd-3dfd-4ad4-8062-186436c57422 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.187033 Nov 19 13:39:28.549170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 318/635] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:28 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:28.602714 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:28.603376 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:28.613014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.613476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.614327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.614761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.651171 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:28.651591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:28.652259 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:28.701277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:28.709416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4d2fff0c-1792-4746-8f8a-7534a916d210 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.110692 Nov 19 13:39:28.710218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 318/636] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:28 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:28.772865 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:39:28.773165 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:39:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:39:29.299971 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:29.300931 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:29.307391 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.307978 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.309501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.310044 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.375777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:29.376397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:29.383777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.384287 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.385037 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.385476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.493868 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:29.503426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:29.505480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:29.506652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-dc7ddadc-c40a-46bb-a5f2-5592b7f723ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.212606 Nov 19 13:39:29.507282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 319/637] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:29 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:29.562948 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:29.567270 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:29.567869 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:29.570925 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3934de8f-0a5d-4767-b486-14a0b321c3f5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.199424 Nov 19 13:39:29.571544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 319/638] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:29 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:29.573742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.574185 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.574966 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.575419 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.727256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:29.728087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:29.733506 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:29.739535 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.739988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.741140 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.741595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.743136 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2fbb7103-b3c7-4b55-bf8e-51048bcef9aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.179670 Nov 19 13:39:29.745246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 320/639] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:29 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:29.778515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:29.778981 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:29.779469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:29.824357 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:29.832152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-41c679f3-f20a-4d5a-aee0-a849374ad7f7 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.108743 Nov 19 13:39:29.832734 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 320/640] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:29 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:30.526708 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:30.527647 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:30.535573 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.536025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.536848 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.537275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.597642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:30.598296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:30.604566 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.605019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.605852 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.606334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.710625 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:30.719367 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:30.720851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:30.722044 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-18c429e9-2492-466c-adfc-28ccf15beddd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.199849 Nov 19 13:39:30.722600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 321/641] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:30 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:30.760851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:30.762307 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:30.769604 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.770030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.770831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.771326 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.779443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:30.786826 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0739dfec-88d2-4f4a-8ce7-525b41c0014d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.195309 Nov 19 13:39:30.787463 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 321/642] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:30 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:30.849590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:30.850182 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:30.856401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.856850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.857656 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.858050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.891445 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:30.891689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:30.892101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lazy-loading 'fault' on Instance uuid df0e9fcb-022c-4369-8d5e-b644024f55aa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:30.922435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:30.931844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58d24cee-42a7-47cb-8e1c-e5c7ee2e0b73 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.174827 Nov 19 13:39:30.933271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 322/643] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:30 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:30.940745 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c7c0bfd6f84b29b28fec4fcef50f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b85b6e9a95402194d48a7909d120a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:30.949278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2909c345-e985-49d4-b92a-9943cfbd3709 tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 200 len: 1308 microversion: 2.1 time: 0.103812 Nov 19 13:39:30.949918 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 322/644] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:30 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:31.742822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:31.743478 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:31.751616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:31.752288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:31.753501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:31.754006 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:31.802876 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:31.803732 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:31.811137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:31.811699 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:31.812492 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:31.812932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:32.200581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:32.209126 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:32.210785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:32.212009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-23758fd9-20fa-4de8-b304-176cc615f246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.474268 Nov 19 13:39:32.212594 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 323/645] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:31 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:32.216966 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:32.217560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:32.223463 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:32.223918 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:32.225295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:32.225578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:32.228398 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:32.236690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-66640270-2434-412f-8757-43738ca5c000 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1314 microversion: 2.1 time: 0.437654 Nov 19 13:39:32.237584 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 323/646] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:31 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:32.245848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:32.246441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] [instance: df0e9fcb-022c-4369-8d5e-b644024f55aa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:32.252594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:32.253031 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:32.253819 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:32.254246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:32.268378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] HTTP exception thrown: Instance df0e9fcb-022c-4369-8d5e-b644024f55aa could not be found. Nov 19 13:39:32.269128 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] Returning 404 to user: Instance df0e9fcb-022c-4369-8d5e-b644024f55aa could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:32.269977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a6f143de-aff6-46d3-9891-afc5e0cc433e tempest-AttachVolumeNegativeTest-1320192679 tempest-AttachVolumeNegativeTest-1320192679-project] 10.222.0.74 "GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa" status: 404 len: 111 microversion: 2.1 time: 0.031473 Nov 19 13:39:32.270507 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 324/647] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:32 2021] GET /compute/v2.1/servers/df0e9fcb-022c-4369-8d5e-b644024f55aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:39:32.364723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:32.373166 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d773ecf4-da9e-4eda-be15-179a4f00fd5a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.159527 Nov 19 13:39:32.373819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 324/648] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:32 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:33.111864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:33.112453 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:33.119469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.119680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.120493 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.120915 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.151495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:33.230951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:33.232919 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:33.241804 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.242543 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.243896 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.244406 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.248013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-65c59121-33ea-4dd2-88ba-e9589b08b14c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 204 len: 0 microversion: 2.1 time: 0.139571 Nov 19 13:39:33.251402 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 325/649] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:33 2021] DELETE /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:33.258334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:33.259533 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:33.267503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.268394 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.270157 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.270784 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.475560 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:33.478656 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:33.483980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0c2efc3c-de3c-49a4-8e53-6a1820d985aa tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1499 microversion: 2.1 time: 0.230891 Nov 19 13:39:33.484501 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 326/650] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:33 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1499 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:33.488243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:33.489157 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:33.489737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:33.490682 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:33.493437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-67d12c85-dce4-4f1e-ae16-b3bdfb117774 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.267117 Nov 19 13:39:33.496638 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.497092 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.497948 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.498382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.505562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 325/651] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:33 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:33.511322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:33.512326 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:33.518721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.519206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.520022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:33.520458 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:33.728157 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:33.735935 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:33.738723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-92def2df-d4e1-499d-835e-7597f299a030 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1567 microversion: 2.1 time: 0.231006 Nov 19 13:39:33.739657 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 326/652] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:33 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:33.744586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-df8bd894-d933-4f6e-ad4c-77f9d8b765ee tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1513 microversion: 2.1 time: 0.258845 Nov 19 13:39:33.757038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 327/653] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:33 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:34.002258 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:34.004113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:34.012352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.012809 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.013592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.014013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.042829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:34.132096 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9f073382-dd2f-45d1-a9b9-529090065606 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "DELETE /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 204 len: 0 microversion: 2.1 time: 0.133083 Nov 19 13:39:34.133496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 327/654] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:33 2021] DELETE /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:34.141623 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:34.142316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:34.149324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.149966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.150783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.151279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.310626 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:34.318413 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-07bfe348-feb2-4600-959c-d15bc8581ff5 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1505 microversion: 2.1 time: 0.180511 Nov 19 13:39:34.318991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 328/655] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:34 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:34.512834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:34.513522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:34.520025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.520489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.521329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.522080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.667970 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:34.679294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:34.680954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:34.682051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6a19c62c-aabd-43d1-a8a5-45cff20a6dba tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.173586 Nov 19 13:39:34.682629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 328/656] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:34 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:34.756455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:34.757065 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:34.765266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.765810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.765934 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:34.766575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:34.766751 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.767740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.772754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.773192 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.773977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:34.774781 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:34.985131 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:34.990548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:34.993414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3e0835f3-a5b6-4b07-9fa0-17c0f1643d38 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1547 microversion: 2.1 time: 0.240641 Nov 19 13:39:34.998816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4f21b1a7-1ddd-4f24-951c-eed356900ec5 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1513 microversion: 2.1 time: 0.237192 Nov 19 13:39:34.999427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 329/657] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:34 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:35.010740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 329/658] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:34 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:35.016293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:35.016797 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:35.022599 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.023045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.023956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.024281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.107240 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] HTTP exception thrown: Cannot 'detach_volume' instance a4794168-fa1e-43da-a27c-e5e83054dd1e while it is in vm_state rescued Nov 19 13:39:35.107840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Returning 409 to user: Cannot 'detach_volume' instance a4794168-fa1e-43da-a27c-e5e83054dd1e while it is in vm_state rescued {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:35.108683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c9afe995-9d41-418a-a5a8-1fd5ee588469 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments/574d8478-fde4-4fc3-aad1-6a952f448c9e" status: 409 len: 152 microversion: 2.1 time: 0.096442 Nov 19 13:39:35.109243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 330/659] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:39:35 2021] DELETE /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments/574d8478-fde4-4fc3-aad1-6a952f448c9e => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 19 13:39:35.118006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:35.118555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:35.125242 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.125705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.126673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.127344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.217886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-12c0aaf1-c3aa-48cd-a622-f540ca7305be tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action" status: 202 len: 0 microversion: 2.1 time: 0.103230 Nov 19 13:39:35.218531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 330/660] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:39:35 2021] POST /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:39:35.226827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:35.227757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:35.234761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.235597 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.236567 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.237201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.352480 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:35.354342 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:35.368197 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.369044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.370738 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.371810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.610448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:35.626032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-595e65ef-5a7a-4946-af41-996caec8a5e8 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1555 microversion: 2.1 time: 0.402931 Nov 19 13:39:35.626646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 331/661] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:35 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1555 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:35.702263 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:35.703222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:35.717033 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.717558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.718548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:35.719111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:35.742097 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:35.751455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9383b84b-ec4d-4aad-92a9-deee0251f475 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1505 microversion: 2.1 time: 0.418210 Nov 19 13:39:35.752318 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 331/662] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:35 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:36.032361 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:36.037089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:36.038316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:36.051436 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.053573 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.056374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.056831 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.057691 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:36.060296 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:36.062204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4e2cbddd-27b8-4ab0-b35a-ee85fc9459f4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.364892 Nov 19 13:39:36.063333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 332/663] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:35 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:36.071482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-53319eee-8c0e-494f-bf94-e18756e360e1 req-37639a66-66d3-4db6-9e3a-66d0ab9bc0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f548133d-928a-4fa3-9c06-f70a614f54d6", "name": "network-vif-deleted", "tag": "b2596b0c-7f9e-4097-ad07-8fbd0a26f76f"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:36.073802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:36.073802 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:36.085515 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-53319eee-8c0e-494f-bf94-e18756e360e1 req-37639a66-66d3-4db6-9e3a-66d0ab9bc0b3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.086700 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-53319eee-8c0e-494f-bf94-e18756e360e1 req-37639a66-66d3-4db6-9e3a-66d0ab9bc0b3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.103083 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-53319eee-8c0e-494f-bf94-e18756e360e1 req-37639a66-66d3-4db6-9e3a-66d0ab9bc0b3 service nova] Creating event network-vif-deleted:b2596b0c-7f9e-4097-ad07-8fbd0a26f76f for instance f548133d-928a-4fa3-9c06-f70a614f54d6 on hv-cinder-81735 Nov 19 13:39:36.110328 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-53319eee-8c0e-494f-bf94-e18756e360e1 req-37639a66-66d3-4db6-9e3a-66d0ab9bc0b3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045113 Nov 19 13:39:36.124522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 333/664] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:36.193591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:36.205303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-40f1ff4c-6208-409f-9ca5-17a44c29f83d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 200 len: 1471 microversion: 2.1 time: 0.186880 Nov 19 13:39:36.206448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 332/665] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:36 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:36.512612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-98bbf40e-5150-4a8d-bf3f-7970b37941f2 req-6d4f7512-fcf9-419b-9380-52e1936c567f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8d33b7-76b2-4041-ab20-d4a74eea2d27", "name": "network-vif-deleted", "tag": "b26c8698-00fd-4150-8e38-3ba244b790a3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:36.515707 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:36.515707 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:36.525925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-98bbf40e-5150-4a8d-bf3f-7970b37941f2 req-6d4f7512-fcf9-419b-9380-52e1936c567f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.526735 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-98bbf40e-5150-4a8d-bf3f-7970b37941f2 req-6d4f7512-fcf9-419b-9380-52e1936c567f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.539831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-98bbf40e-5150-4a8d-bf3f-7970b37941f2 req-6d4f7512-fcf9-419b-9380-52e1936c567f service nova] Creating event network-vif-deleted:b26c8698-00fd-4150-8e38-3ba244b790a3 for instance 4a8d33b7-76b2-4041-ab20-d4a74eea2d27 on hv-cinder-81735 Nov 19 13:39:36.547009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-98bbf40e-5150-4a8d-bf3f-7970b37941f2 req-6d4f7512-fcf9-419b-9380-52e1936c567f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037902 Nov 19 13:39:36.547748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 334/666] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:36.646390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:36.648961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:36.655553 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.655553 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.656075 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.656549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.769600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:36.770232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:36.776748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.777309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.778359 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.778882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.806423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:36.815697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-425ff674-e85a-4c02-ac26-1f2e5a8b201e tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1555 microversion: 2.1 time: 0.174803 Nov 19 13:39:36.816271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 333/667] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:36 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:36.817400 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:36.817815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:36.818322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lazy-loading 'fault' on Instance uuid 4a8d33b7-76b2-4041-ab20-d4a74eea2d27 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:36.862496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:36.870817 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de895fcb-e3f4-4eae-af5a-5aac0e6b99cf tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 200 len: 1304 microversion: 2.1 time: 0.105353 Nov 19 13:39:36.871443 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 335/668] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:36 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:37.087236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:37.087847 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:37.101645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.102498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.103331 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.103767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.224906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:37.225631 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: f548133d-928a-4fa3-9c06-f70a614f54d6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:37.232394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.232851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.233639 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.234072 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.248469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:37.248807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] HTTP exception thrown: Instance f548133d-928a-4fa3-9c06-f70a614f54d6 could not be found. Nov 19 13:39:37.249401 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Returning 404 to user: Instance f548133d-928a-4fa3-9c06-f70a614f54d6 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:37.250245 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ba6502de-25ba-4187-9d22-37a1b4649b13 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6" status: 404 len: 111 microversion: 2.1 time: 0.029251 Nov 19 13:39:37.250823 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 336/669] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:37 2021] GET /compute/v2.1/servers/f548133d-928a-4fa3-9c06-f70a614f54d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 13:39:37.259168 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:37.260944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:37.262143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-68fe3551-8b69-413d-a3ba-8d8e74126756 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.179762 Nov 19 13:39:37.262743 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 334/670] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:37 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:37.833111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:37.833721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:37.840693 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.841133 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.841955 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.842378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.893029 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:37.893645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: 4a8d33b7-76b2-4041-ab20-d4a74eea2d27] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:37.900170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.900712 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.901532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:37.902022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:37.916991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] HTTP exception thrown: Instance 4a8d33b7-76b2-4041-ab20-d4a74eea2d27 could not be found. Nov 19 13:39:37.917601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Returning 404 to user: Instance 4a8d33b7-76b2-4041-ab20-d4a74eea2d27 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:37.918448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-752f8bc6-52cb-4a4a-96ab-3c289d62148b tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27" status: 404 len: 111 microversion: 2.1 time: 0.029265 Nov 19 13:39:37.919013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 335/671] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:37 2021] GET /compute/v2.1/servers/4a8d33b7-76b2-4041-ab20-d4a74eea2d27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 13:39:37.996272 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:38.004372 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-94040e68-6fba-45c8-9ec1-faf99bbbf979 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1561 microversion: 2.1 time: 0.174994 Nov 19 13:39:38.004963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 337/672] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:37 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:38.018845 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1587226087", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "a9ae6f60-90f0-4ba8-9236-d97d59dc896f"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:38.074054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] validate_networks() for [('a9ae6f60-90f0-4ba8-9236-d97d59dc896f', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:39:38.074646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:38.075128 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:38.081104 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.081562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.082352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.082784 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.166702 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lazy-loading 'services' on Instance uuid a4794168-fa1e-43da-a27c-e5e83054dd1e {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:38.243809 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8d5aa609-309c-44bf-a172-d27177c0bf1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments/574d8478-fde4-4fc3-aad1-6a952f448c9e" status: 202 len: 0 microversion: 2.1 time: 0.172859 Nov 19 13:39:38.244459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 338/673] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:39:38 2021] DELETE /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments/574d8478-fde4-4fc3-aad1-6a952f448c9e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:39:38.253063 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:38.255393 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:38.266949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.267549 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.268539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.269104 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.301644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3b46b178-c86f-4113-b40e-2c617699ea87 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052537 Nov 19 13:39:38.302335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 339/674] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:39:38 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:39:38.310089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:38.310772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:38.316997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.317516 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.318481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.320650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.492181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:39:38.492599 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:39:38.493091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:39:38.493648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:39:38.494054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:39:38.504586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.505035 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.506136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:38.506841 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:38.524266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Getting quotas for project ae645dfd25a84e94ab2e84a62ce1826e. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:39:38.528819 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Getting quotas for user 717543a064f44f75b48734a031c0571a and project ae645dfd25a84e94ab2e84a62ce1826e. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:39:38.529998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:38.538707 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:38.540361 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:38.540602 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:39:38.541688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4f562ab9-55f1-4a4f-916d-649795d76f0b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.238134 Nov 19 13:39:38.542335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 340/675] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:38 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:38.543040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:39:38.602337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-42eebef4-d972-448c-bab3-d9073e968b18 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587332 Nov 19 13:39:38.603421 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 336/676] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:39:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:39:38.613392 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d12db5d3-5305-4e38-999c-b67b0c21f19d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:38.614038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d12db5d3-5305-4e38-999c-b67b0c21f19d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:38.669341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d12db5d3-5305-4e38-999c-b67b0c21f19d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:38.676243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d12db5d3-5305-4e38-999c-b67b0c21f19d tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1214 microversion: 2.1 time: 0.066789 Nov 19 13:39:38.676861 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 341/677] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:38 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:39.314740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:39.316126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:39.323807 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:39.324265 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:39.325179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:39.325623 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:39.357520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-43857ce0-6e1e-4b19-a905-52adb0386bda tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Nov 19 13:39:39.358108 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 337/678] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:39:39 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:39.561379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:39.562023 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:39.568927 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:39.569314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:39.570101 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:39.570535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:39.693988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:39.694595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:39.700923 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:39.701378 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:39.702172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:39.702610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:39.719654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:39.728895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:39.730439 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:39.731650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d1395d05-c335-4382-b153-769e725dd942 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.174544 Nov 19 13:39:39.732229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 342/679] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:39 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:39.766410 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:39.774330 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6dac2743-7f61-40d2-9a4a-70417f0ce935 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1218 microversion: 2.1 time: 0.084277 Nov 19 13:39:39.774906 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 338/680] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:39 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:40.371434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:40.372782 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:40.381716 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:40.382148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:40.382932 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:40.383390 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:40.414765 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-25b2d5c2-fe27-4976-aa6a-3176e60385aa tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047609 Nov 19 13:39:40.415353 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 343/681] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:39:40 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:39:40.750575 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:40.751209 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:40.759224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:40.759773 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:40.760807 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:40.761328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:40.791144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:40.791963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:40.811678 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:40.812534 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:40.813372 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:40.813805 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:40.893712 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:40.902890 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-191b6801-476a-4f8a-a8f6-d9831ec7a747 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1266 microversion: 2.1 time: 0.115940 Nov 19 13:39:40.903584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 344/682] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:40 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:40.938465 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:40.953471 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:40.957342 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:40.959415 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-04aa3395-8819-42de-b27f-649067fdcf74 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.212133 Nov 19 13:39:40.960357 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 339/683] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:40 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:40.963958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:39:40.964188 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:39:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:39:41.426847 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:41.427829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:41.434616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:41.435060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:41.435864 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:41.436287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:41.468431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9506f1a2-ad85-460d-8c14-2fca72f3cbc3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045512 Nov 19 13:39:41.475892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 345/684] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:39:41 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:39:41.923505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:41.924525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:41.935015 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:41.935793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:41.938477 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:41.939307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:41.980332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:41.981165 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:41.992721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:41.993293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:41.994103 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:41.999171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:42.264933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:42.273010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-142fa3d9-392b-4aea-851d-a24d708ebfbe tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.355125 Nov 19 13:39:42.283294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 340/685] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:41 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:42.304699 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:42.315227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:42.316813 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:42.318114 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f016d7d8-daef-4540-98cd-001eb36344e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.343947 Nov 19 13:39:42.319137 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 346/686] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:41 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:42.625285 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-98145073-7647-430a-a0b5-946dda3719c4 req-fa65971e-d6f3-43e6-9b30-84644f030a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb", "tag": "06e43c0d-d391-4c06-960d-efb3cba2aec3"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:42.627948 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:42.627948 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:42.644384 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-98145073-7647-430a-a0b5-946dda3719c4 req-fa65971e-d6f3-43e6-9b30-84644f030a09 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:42.644828 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-98145073-7647-430a-a0b5-946dda3719c4 req-fa65971e-d6f3-43e6-9b30-84644f030a09 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:42.656393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-98145073-7647-430a-a0b5-946dda3719c4 req-fa65971e-d6f3-43e6-9b30-84644f030a09 service nova] Creating event network-changed:06e43c0d-d391-4c06-960d-efb3cba2aec3 for instance cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb on hv-cinder-81735 Nov 19 13:39:42.661044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-98145073-7647-430a-a0b5-946dda3719c4 req-fa65971e-d6f3-43e6-9b30-84644f030a09 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043134 Nov 19 13:39:42.661639 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 341/687] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:43.290491 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:43.291072 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:43.297675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.298351 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.299193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.299757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.336911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:43.338300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:43.345633 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.346184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.347082 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.347803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.491923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:43.501246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9a31836e-d7ca-43fb-b4b4-40eaea02282f tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.214836 Nov 19 13:39:43.502295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 347/688] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:43 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:43.529431 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:43.538450 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:43.539987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:43.541185 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-45ee4df5-f10e-47ea-8cee-be03e899596a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.208744 Nov 19 13:39:43.541786 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 342/689] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:43 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:43.835049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:43.835572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:43.842295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.842671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.843527 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.843952 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.870561 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:43.954164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b32257ab-caab-4a64-a999-e7e07f1a8df4 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "DELETE /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 204 len: 0 microversion: 2.1 time: 0.122375 Nov 19 13:39:43.955033 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 348/690] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:43 2021] DELETE /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:43.964842 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:43.965616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:43.973701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.974020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:43.974850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:43.975373 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:44.160757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:44.169668 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cc1b43b6-7b45-4b6a-9b6f-5c17694d7dd3 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1507 microversion: 2.1 time: 0.209376 Nov 19 13:39:44.170311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 343/691] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:43 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:44.295521 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-5c0d4ddb-d206-49c9-911d-301ca40ac86c req-e7f1a952-23a3-47c4-8979-187b188df881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "name": "network-vif-plugged", "status": "completed", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:44.297532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:44.297532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:44.307139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-5c0d4ddb-d206-49c9-911d-301ca40ac86c req-e7f1a952-23a3-47c4-8979-187b188df881 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:44.308000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-5c0d4ddb-d206-49c9-911d-301ca40ac86c req-e7f1a952-23a3-47c4-8979-187b188df881 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:44.323893 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-5c0d4ddb-d206-49c9-911d-301ca40ac86c req-e7f1a952-23a3-47c4-8979-187b188df881 service nova] Creating event network-vif-plugged:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:39:44.329469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-5c0d4ddb-d206-49c9-911d-301ca40ac86c req-e7f1a952-23a3-47c4-8979-187b188df881 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038727 Nov 19 13:39:44.330154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 349/692] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:44.518457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:44.519064 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:44.526086 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:44.526542 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:44.527383 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:44.527837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:44.560209 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:44.560960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:44.567548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:44.568000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:44.569215 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:44.569670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:44.722698 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:44.730936 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-096a8181-120e-423f-a02f-7f2efbbe6ab1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.216169 Nov 19 13:39:44.731580 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 344/693] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:44 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:44.751920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:44.761338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:44.762884 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:44.764061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-25b022ee-c854-4412-8077-64dd825fb453 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.208228 Nov 19 13:39:44.764628 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 350/694] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:44 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:45.187574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:45.188184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:45.195367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:45.195867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:45.196701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:45.197128 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:45.350753 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:45.360661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0045d409-12ca-46b7-9b25-596bb7bc1c84 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1507 microversion: 2.1 time: 0.177391 Nov 19 13:39:45.361344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 345/695] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:45 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:45.748013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:45.748868 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:45.757763 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:45.758437 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:45.759496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:45.760113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:45.781966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:45.782526 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:45.789275 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:45.789724 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:45.790508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:45.790944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:45.965663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:45.968746 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:45.975626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6aebc7f6-d80a-4ec0-ab70-ca7d77c872f3 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.231693 Nov 19 13:39:45.976353 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 351/696] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:45 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:45.985132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:45.986770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:45.988251 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b7b16ddd-c37a-424a-96a1-2e9cabfd3004 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.210197 Nov 19 13:39:45.988925 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 346/697] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:45 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:46.377761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:46.378362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:46.385222 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:46.385656 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:46.386427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:46.386875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:46.536206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:46.545825 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-be4aa58f-190d-4cd9-9267-b6c44ef3619f tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1507 microversion: 2.1 time: 0.171674 Nov 19 13:39:46.546430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 352/698] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:46 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:46.833788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:46.834506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:46.841096 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:46.841549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:46.842347 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:46.842783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:46.927283 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lazy-loading 'services' on Instance uuid 74979cdc-e64b-40da-8cf1-7f6311e51aec {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:46.992509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:46.993135 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:47.001448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.001448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.001448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.001448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.003892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dcd0fc69-6197-469c-b612-5db93c4e3e89 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-volume_attachments/111f2410-37f1-4d1c-8289-457784f8c860" status: 202 len: 0 microversion: 2.1 time: 0.173818 Nov 19 13:39:47.004819 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 347/699] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:39:46 2021] DELETE /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-volume_attachments/111f2410-37f1-4d1c-8289-457784f8c860 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:39:47.011152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:47.011564 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:47.019407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.019929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.021402 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.021961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.265009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:47.269434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:47.273860 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:47.275490 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:47.276664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f38f65fc-a21f-4cd1-b7f7-ec2bdd086ad6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.270747 Nov 19 13:39:47.277244 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 348/700] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:47 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:47.278428 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-56fae71a-d439-42c4-b809-fd1838c4b941 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.289919 Nov 19 13:39:47.281717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-266962613", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "networks": [{"uuid": "a62e8e54-023d-4eec-b3f2-04ffff4d4874"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:47.288569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 353/701] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:46 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:47.337355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] validate_networks() for [('a62e8e54-023d-4eec-b3f2-04ffff4d4874', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:39:47.563483 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:47.564016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:47.570368 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.570829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.571659 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.572089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.846172 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:47.856876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-07a76d16-68a0-4712-8dc2-dbfc9a4d97f9 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1507 microversion: 2.1 time: 0.297159 Nov 19 13:39:47.857854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 354/702] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:47 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:47.870782 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:39:47.871347 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:39:47.871988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:39:47.872893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:39:47.873472 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:39:47.888348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.889066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.890238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:47.890849 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:47.924487 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Getting quotas for project ff2cb9958b6a458eb2517bc6efab7024. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:39:47.935810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Getting quotas for user ebdffdb934bc42e9aa6c934625cab499 and project ff2cb9958b6a458eb2517bc6efab7024. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:39:47.950908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:39:47.953415 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:39:48.007904 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-34c3de5f-21ea-4e13-a95f-62ed61e3789d tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729573 Nov 19 13:39:48.008635 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 349/703] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:39:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:39:48.020121 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b9c987a8-9b52-461a-becd-6594b8e25782 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:48.021810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b9c987a8-9b52-461a-becd-6594b8e25782 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:48.100093 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b9c987a8-9b52-461a-becd-6594b8e25782 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:48.120262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b9c987a8-9b52-461a-becd-6594b8e25782 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1218 microversion: 2.1 time: 0.105023 Nov 19 13:39:48.120878 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 355/704] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:48 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:48.140281 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-97a0ef85-6a41-4ce6-920d-b314c18026f6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:48.147890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-97a0ef85-6a41-4ce6-920d-b314c18026f6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.148399 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-97a0ef85-6a41-4ce6-920d-b314c18026f6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.194819 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-97a0ef85-6a41-4ce6-920d-b314c18026f6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Going to try to stop instance {{(pid=122815) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 13:39:48.260855 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-97a0ef85-6a41-4ce6-920d-b314c18026f6 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 202 len: 0 microversion: 2.1 time: 0.123858 Nov 19 13:39:48.262653 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 350/705] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:39:48 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:39:48.269935 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:48.270571 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:48.277320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.277763 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.278578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.278996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.295706 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:48.296407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:48.305720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.306171 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.306973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.307435 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.574487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:48.577916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:48.586714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b9da1cd-b4e3-47ce-a094-16c71f892e4e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.316988 Nov 19 13:39:48.587502 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:48.589019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:48.590237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-131868cb-8425-4194-9ce8-ba9b7570f941 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1807 microversion: 2.20 time: 0.298824 Nov 19 13:39:48.600902 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 351/706] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:48 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:39:48.600902 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:48.600902 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:48.601439 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 356/707] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:48 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:48.602235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.602695 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.603809 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.604283 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.785499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:48.798290 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-86be32e1-2887-4112-ac0f-4b28c30f2778 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.203915 Nov 19 13:39:48.812279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 352/708] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:48 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:48.875636 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:48.876536 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:48.883610 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.884321 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:48.886424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:48.887039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:49.055159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:49.076278 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-54acc5d0-492b-40c6-b7f9-4201a825f01b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1507 microversion: 2.1 time: 0.205611 Nov 19 13:39:49.085097 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 357/709] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:48 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:49.137278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:49.138496 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:49.145610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:49.146447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:49.147561 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:49.148223 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:49.238782 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:49.247645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a6b15f28-2457-467d-8046-f06f535e4f0b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1270 microversion: 2.1 time: 0.113373 Nov 19 13:39:49.248667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 353/710] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:49 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:49.604772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:49.606001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:49.611617 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:49.612700 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:49.613832 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:49.614457 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:49.615528 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:49.616292 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:49.626667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:49.628687 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:49.635166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:49.636190 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.092441 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.096345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.103172 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-75d10391-a10b-4cf1-854d-5949cd65d31e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.502197 Nov 19 13:39:50.104998 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.109544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.112087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-87156f74-bcc5-4f3e-a66c-9e2bacc2e0e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1794 microversion: 2.20 time: 0.506493 Nov 19 13:39:50.112655 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 354/711] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:39:49 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1794 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:39:50.116933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 358/712] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:49 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:50.124456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:50.125299 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:50.129283 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-2368fa1f-6df2-42ee-8873-73d21c1a7371 req-ea4fb9cd-95a0-436f-903a-103276ff272e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7b2c50-f670-44be-bd04-8568a80c19a6", "name": "network-vif-deleted", "tag": "fec92600-3dc3-4e88-b748-97fe65ccb089"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:50.135256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:50.135256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:50.136335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.137009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.138394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.139068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.171348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-2368fa1f-6df2-42ee-8873-73d21c1a7371 req-ea4fb9cd-95a0-436f-903a-103276ff272e service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.172697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-2368fa1f-6df2-42ee-8873-73d21c1a7371 req-ea4fb9cd-95a0-436f-903a-103276ff272e service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.197255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-2368fa1f-6df2-42ee-8873-73d21c1a7371 req-ea4fb9cd-95a0-436f-903a-103276ff272e service nova] Creating event network-vif-deleted:fec92600-3dc3-4e88-b748-97fe65ccb089 for instance dc7b2c50-f670-44be-bd04-8568a80c19a6 on hv-cinder-81735 Nov 19 13:39:50.203031 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-2368fa1f-6df2-42ee-8873-73d21c1a7371 req-ea4fb9cd-95a0-436f-903a-103276ff272e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086818 Nov 19 13:39:50.208801 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 355/713] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:50.214749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:50.215805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:50.223570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.224434 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.225492 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.226401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.265418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.266117 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.266798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lazy-loading 'fault' on Instance uuid dc7b2c50-f670-44be-bd04-8568a80c19a6 {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:50.333864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.349416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a3b2b02a-fffe-4255-b344-ac541e09f364 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 200 len: 1312 microversion: 2.1 time: 0.138558 Nov 19 13:39:50.351628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 356/714] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:50 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:50.356909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:50.359763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:50.366555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.367003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.367827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:50.368289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:50.461505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.471405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-262a3c62-c9ff-42f1-be93-759fd05c5653 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1276 microversion: 2.1 time: 0.118465 Nov 19 13:39:50.472979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 357/715] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:50 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:50.539806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:50.548202 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-97bcb69f-38d2-4116-941d-71925f65f5da tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.430011 Nov 19 13:39:50.548687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 359/716] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:50 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:51.124606 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:51.125373 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:51.132304 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.132768 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.134079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.134740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.370167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:51.372326 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: dc7b2c50-f670-44be-bd04-8568a80c19a6] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:51.381201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.382154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.383218 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.383651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.400723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] HTTP exception thrown: Instance dc7b2c50-f670-44be-bd04-8568a80c19a6 could not be found. Nov 19 13:39:51.401633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Returning 404 to user: Instance dc7b2c50-f670-44be-bd04-8568a80c19a6 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:51.402751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-77f64316-1a06-4652-8564-40a7dd1650ac tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6" status: 404 len: 111 microversion: 2.1 time: 0.038381 Nov 19 13:39:51.403316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 360/717] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:51 2021] GET /compute/v2.1/servers/dc7b2c50-f670-44be-bd04-8568a80c19a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:39:51.411422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:51.412313 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:51.417226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:51.419820 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.420616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.421990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.422693 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.437010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6ec25921-fc79-48e7-8fff-a3830bc1bda9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.316211 Nov 19 13:39:51.438052 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 358/718] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:51 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:51.465253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:51.490121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:51.490752 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:51.498172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.498916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.500083 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.500728 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.571768 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9893ae62-fbb1-4cda-86a3-03ece0940d1b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 204 len: 0 microversion: 2.1 time: 0.163438 Nov 19 13:39:51.572641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 361/719] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:51 2021] DELETE /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 13:39:51.580552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:51.581807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:51.587900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.588490 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.589379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:51.589927 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:51.998586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:52.007459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-aaf961a6-d522-42e0-b90a-53625aa6a5e6 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.521006 Nov 19 13:39:52.017111 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 359/720] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:51 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:52.022188 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:52.022892 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:52.029257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:52.029785 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:52.030657 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:52.031161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:52.097287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:52.105590 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-126e7db2-66aa-4f3d-bb7c-8dcf60ccb6d9 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.530700 Nov 19 13:39:52.106238 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 362/721] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:51 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:52.110854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-eacb49d3-cfef-4676-ae08-4c6bcb17dffe req-7a9d8d76-23ce-4cce-b458-c2578d393f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb", "name": "network-vif-plugged", "status": "completed", "tag": "06e43c0d-d391-4c06-960d-efb3cba2aec3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:52.112657 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:52.112657 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:52.120492 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-eacb49d3-cfef-4676-ae08-4c6bcb17dffe req-7a9d8d76-23ce-4cce-b458-c2578d393f25 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:52.121014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-eacb49d3-cfef-4676-ae08-4c6bcb17dffe req-7a9d8d76-23ce-4cce-b458-c2578d393f25 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:52.134295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-eacb49d3-cfef-4676-ae08-4c6bcb17dffe req-7a9d8d76-23ce-4cce-b458-c2578d393f25 service nova] Creating event network-vif-plugged:06e43c0d-d391-4c06-960d-efb3cba2aec3 for instance cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb on hv-cinder-81735 Nov 19 13:39:52.139496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-eacb49d3-cfef-4676-ae08-4c6bcb17dffe req-7a9d8d76-23ce-4cce-b458-c2578d393f25 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032102 Nov 19 13:39:52.140319 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 363/722] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:52.145312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-d84ed80d-5183-4758-9134-505c13df4f06 req-ded6d1a4-4d67-4e4d-b836-18c3f95e8fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d12b91a-e989-4541-a158-3f61d7be4b0d", "tag": "07b78e5c-45ba-4349-b0e3-1ba23f341e17"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:52.146876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:52.146876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:52.155960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d84ed80d-5183-4758-9134-505c13df4f06 req-ded6d1a4-4d67-4e4d-b836-18c3f95e8fb1 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:52.156396 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d84ed80d-5183-4758-9134-505c13df4f06 req-ded6d1a4-4d67-4e4d-b836-18c3f95e8fb1 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:52.168432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-d84ed80d-5183-4758-9134-505c13df4f06 req-ded6d1a4-4d67-4e4d-b836-18c3f95e8fb1 service nova] Creating event network-changed:07b78e5c-45ba-4349-b0e3-1ba23f341e17 for instance 6d12b91a-e989-4541-a158-3f61d7be4b0d on hv-cinder-81735 Nov 19 13:39:52.174014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-d84ed80d-5183-4758-9134-505c13df4f06 req-ded6d1a4-4d67-4e4d-b836-18c3f95e8fb1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032427 Nov 19 13:39:52.175008 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 364/723] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:52.367456 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:52.376538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ac149d16-d20a-4188-b877-384678d7d457 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.357851 Nov 19 13:39:52.377050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 360/724] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:52 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:52.458142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:52.460623 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:52.472306 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:52.473352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:52.474420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:52.475618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:52.628476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:52.637723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d56b4a22-5696-4717-9fe1-a0f550964d8b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.184282 Nov 19 13:39:52.638583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 365/725] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:52 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:53.024823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:53.025433 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:53.031579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.031967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.032955 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.033756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.125113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:53.126034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:53.133554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.134407 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.135438 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.136164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.300998 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:53.309967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-218f8b28-cb1c-4820-a083-fe10e193fb0f tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.289085 Nov 19 13:39:53.310705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 361/726] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:53 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:53.400856 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:53.401859 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:53.408520 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:53.409104 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.409770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.410992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.411683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.428836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c70e8efa-c6dd-42e8-805a-9010e6e7af8a tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1314 microversion: 2.1 time: 0.305894 Nov 19 13:39:53.441486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 366/727] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:53 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:53.564112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:53.572014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bdbd79af-1406-4ae7-9638-e04d88d40e6a tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.177839 Nov 19 13:39:53.572770 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 362/728] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:53 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:53.660554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:53.661203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:53.669951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.670617 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.672234 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:53.673723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:53.848558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:53.857501 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f07a908a-10b7-4da2-aa08-b6b2266a9b73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.203748 Nov 19 13:39:53.872495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 367/729] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:53 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:54.327353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:54.327995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:54.335219 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.335802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.336591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.337021 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.445672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:54.446301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:54.452303 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.452775 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.453513 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.453979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.474666 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:54.482452 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-488a6404-5038-4fd3-beb0-31d009276ee9 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.158936 Nov 19 13:39:54.483084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 363/730] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:54 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:54.585572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:54.589142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:54.589755 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:54.593670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cf9cd73e-d0d3-41fe-843e-0fba20b9c4eb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1498 microversion: 2.1 time: 0.151773 Nov 19 13:39:54.594251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 368/731] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:54 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:54.595736 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.596190 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.596973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.597418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.740595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:54.748651 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a6ea8510-59f3-407e-8c50-042273f55194 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.163188 Nov 19 13:39:54.749198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 364/732] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:54 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:54.874785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:54.875490 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:54.882206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.882652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:54.883493 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:54.883921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.023973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:55.035850 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d5b14bda-c3d6-4eb0-a0d9-447054bb45df tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.164545 Nov 19 13:39:55.036853 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 369/733] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:54 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:55.079596 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:55.080210 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:55.088942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.089600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.090782 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.091262 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.117510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:39:55.217953 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9c8aa9ff-0af4-4d22-961d-9a205b7f92d7 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "DELETE /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 204 len: 0 microversion: 2.1 time: 0.141809 Nov 19 13:39:55.218551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 365/734] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:39:55 2021] DELETE /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:39:55.227459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:55.228077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:55.234108 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.234557 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.235365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.235794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.375332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:55.382746 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5ab6215e-62c9-4d0d-bfc4-6dd7ab7eb4a2 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1504 microversion: 2.1 time: 0.159803 Nov 19 13:39:55.383523 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 370/735] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:55 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:55.503789 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:55.504601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:55.514051 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.514506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.515345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.515780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.653758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:55.661665 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ff46db43-4f60-4c40-b279-753637fe427b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.164608 Nov 19 13:39:55.662320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 366/736] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:55 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:55.765776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:55.766375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:55.772291 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.773228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.773691 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:55.774121 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:55.916188 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:55.923859 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7e3e5acd-4633-410f-a060-bfb90b96aef5 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.161710 Nov 19 13:39:55.924440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 371/737] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:55 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:56.063764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:56.064422 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:56.072347 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.072804 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.073974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.074729 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.400046 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:56.400738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:56.407312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.407831 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.408692 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.409210 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.447050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:56.454877 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-117c5499-e08c-4f83-b2ea-28a96388f1b8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.397054 Nov 19 13:39:56.455495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 367/738] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:56 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:56.548661 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:56.561370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a0d95701-2568-4890-8dd3-21a5bfc4b201 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1504 microversion: 2.1 time: 0.164803 Nov 19 13:39:56.562287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 372/739] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:56 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:56.678382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:56.678979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:56.687362 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.687362 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.688896 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.689375 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.832106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:56.842895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-757f8148-0a55-4165-aeb7-8ef93381d0eb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.168471 Nov 19 13:39:56.853006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 368/740] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:56 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:56.941524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:56.942452 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:56.948688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.949152 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:56.949937 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:56.950354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.178429 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:57.186834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1590b677-363c-4aaf-b257-c09de50e1094 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.249039 Nov 19 13:39:57.187650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 373/741] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:56 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:57.472489 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:57.473182 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:57.485104 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.485557 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.486327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.487007 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.487506 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-afefba90-fd3f-42bb-85d6-c77e40d46f25 req-1455c896-922d-4d70-aacb-d55309f22c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb", "name": "network-vif-deleted", "tag": "06e43c0d-d391-4c06-960d-efb3cba2aec3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:57.489144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:57.489144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:39:57.498894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-afefba90-fd3f-42bb-85d6-c77e40d46f25 req-1455c896-922d-4d70-aacb-d55309f22c79 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.499851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-afefba90-fd3f-42bb-85d6-c77e40d46f25 req-1455c896-922d-4d70-aacb-d55309f22c79 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.511850 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-afefba90-fd3f-42bb-85d6-c77e40d46f25 req-1455c896-922d-4d70-aacb-d55309f22c79 service nova] Creating event network-vif-deleted:06e43c0d-d391-4c06-960d-efb3cba2aec3 for instance cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb on hv-cinder-81735 Nov 19 13:39:57.517800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-afefba90-fd3f-42bb-85d6-c77e40d46f25 req-1455c896-922d-4d70-aacb-d55309f22c79 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Nov 19 13:39:57.518414 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 374/742] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:57.581925 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:57.582620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:57.588861 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.589315 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.590117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.590550 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.629592 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:57.638653 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dbd5aa8b-d1b7-4237-9272-240bb112f063 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1677 microversion: 2.1 time: 0.170139 Nov 19 13:39:57.639508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 369/743] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:57 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:57.656526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717543a064f44f75b48734a031c0571a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae645dfd25a84e94ab2e84a62ce1826e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:57.664749 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-197d065e-8aa6-41ce-8f5b-fb08d31311f1 tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 200 len: 1299 microversion: 2.1 time: 0.086801 Nov 19 13:39:57.665333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 375/744] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:57 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:39:57.816330 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-eae6f5d7-41d4-43f3-baf7-d7d59d9268ba req-d3164c58-93f9-49cf-8d5d-bfb3a90dc3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d12b91a-e989-4541-a158-3f61d7be4b0d", "name": "network-vif-plugged", "status": "completed", "tag": "07b78e5c-45ba-4349-b0e3-1ba23f341e17"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:57.817944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:57.817944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:57.827302 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-eae6f5d7-41d4-43f3-baf7-d7d59d9268ba req-d3164c58-93f9-49cf-8d5d-bfb3a90dc3f7 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.827823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-eae6f5d7-41d4-43f3-baf7-d7d59d9268ba req-d3164c58-93f9-49cf-8d5d-bfb3a90dc3f7 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.841183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-eae6f5d7-41d4-43f3-baf7-d7d59d9268ba req-d3164c58-93f9-49cf-8d5d-bfb3a90dc3f7 service nova] Creating event network-vif-plugged:07b78e5c-45ba-4349-b0e3-1ba23f341e17 for instance 6d12b91a-e989-4541-a158-3f61d7be4b0d on hv-cinder-81735 Nov 19 13:39:57.846227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-eae6f5d7-41d4-43f3-baf7-d7d59d9268ba req-d3164c58-93f9-49cf-8d5d-bfb3a90dc3f7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033941 Nov 19 13:39:57.847120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 370/745] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:39:57.866624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:57.867319 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:57.875779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.876247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:57.877049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:57.877480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.046534 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:58.054786 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c4772b76-3f50-4d0f-83c1-641f4fc7b85b tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.196706 Nov 19 13:39:58.055828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 376/746] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:57 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:58.206926 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:58.207648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:58.214265 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.214713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.215536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.215972 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.377011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:58.385130 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0aba9b4f-218a-494b-82f2-6b3482ecb223 tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1521 microversion: 2.1 time: 0.182748 Nov 19 13:39:58.385710 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 371/747] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:58 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:58.657544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:58.658411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:58.665714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.666242 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.667129 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.667654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.681515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:58.682235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] [instance: cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:58.688750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.689455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.690336 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.690955 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.705568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] HTTP exception thrown: Instance cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb could not be found. Nov 19 13:39:58.706162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] Returning 404 to user: Instance cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:39:58.707010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7d3f66d4-8b41-41ac-97a8-05e00545ebdb tempest-VolumesActionsTest-846947674 tempest-VolumesActionsTest-846947674-project] 10.222.0.74 "GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb" status: 404 len: 111 microversion: 2.1 time: 0.029324 Nov 19 13:39:58.713160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 372/748] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:58 2021] GET /compute/v2.1/servers/cf2450c6-d6d3-4ec8-b2ad-ff620fb1e5fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:39:58.919181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:58.929069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8aea1a32-24e3-451b-acdf-f1a8e3666781 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1654 microversion: 2.1 time: 0.276380 Nov 19 13:39:58.929893 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 377/749] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:58 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1654 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:58.947590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-414ac7c9-03b0-43b3-b470-ebf60b697b49 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:58.958795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-414ac7c9-03b0-43b3-b470-ebf60b697b49 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:58.959388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-414ac7c9-03b0-43b3-b470-ebf60b697b49 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:58.986312 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-414ac7c9-03b0-43b3-b470-ebf60b697b49 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Going to try to start instance {{(pid=122815) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 13:39:59.033588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-414ac7c9-03b0-43b3-b470-ebf60b697b49 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action" status: 202 len: 0 microversion: 2.1 time: 0.089951 Nov 19 13:39:59.034529 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 373/750] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:39:58 2021] POST /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:39:59.043660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:59.044257 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:59.055728 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.056370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.057179 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.057487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.073552 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:59.074612 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:59.086267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.087071 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.088882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.089458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.285620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:59.297838 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5712e1f4-f508-41d6-adad-f54172aafbbe tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1663 microversion: 2.1 time: 0.258255 Nov 19 13:39:59.298989 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 378/751] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:59 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1663 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:59.401957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:39:59.402758 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:39:59.403772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:59.415929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8fd86a5e-18bc-451a-8129-bd6806fa8119 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1318 microversion: 2.1 time: 0.344150 Nov 19 13:39:59.416869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 374/752] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:59 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:59.416997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.417510 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.418477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.419009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.460945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.461461 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.462099 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lazy-loading 'fault' on Instance uuid a4794168-fa1e-43da-a27c-e5e83054dd1e {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:39:59.518511 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e8eed657b4628a26887809588106e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe06ab44f6d441fbd48e98b2ba2119b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:39:59.529616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ccbf840a-bcdf-4ab8-a0cd-735a3dc0677b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 200 len: 1312 microversion: 2.1 time: 0.131324 Nov 19 13:39:59.530218 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 379/753] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:39:59 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:39:59.543485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-a4587998-fa87-470d-8bd8-295a29d86321 req-7635ded7-596d-4262-8fb3-bc8acef499c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4794168-fa1e-43da-a27c-e5e83054dd1e", "name": "network-vif-deleted", "tag": "77e22262-852e-4b88-94f2-ccf9b7f9c066"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:39:59.545405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:39:59.545405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:39:59.565574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-a4587998-fa87-470d-8bd8-295a29d86321 req-7635ded7-596d-4262-8fb3-bc8acef499c7 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:39:59.571271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-a4587998-fa87-470d-8bd8-295a29d86321 req-7635ded7-596d-4262-8fb3-bc8acef499c7 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:39:59.601466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-a4587998-fa87-470d-8bd8-295a29d86321 req-7635ded7-596d-4262-8fb3-bc8acef499c7 service nova] Creating event network-vif-deleted:77e22262-852e-4b88-94f2-ccf9b7f9c066 for instance a4794168-fa1e-43da-a27c-e5e83054dd1e on hv-cinder-81735 Nov 19 13:39:59.613030 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-a4587998-fa87-470d-8bd8-295a29d86321 req-7635ded7-596d-4262-8fb3-bc8acef499c7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075143 Nov 19 13:39:59.613905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 375/754] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:40:00.316619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:00.317184 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:00.324157 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.324583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.325354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.325786 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.433798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:00.434565 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:00.441168 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.441631 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.442414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.442843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.467249 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:00.475225 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3f66ba58-918a-40b6-a929-f96bf11911f0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1663 microversion: 2.1 time: 0.162244 Nov 19 13:40:00.475868 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 380/755] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:00 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:40:00.547051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:00.547966 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] [instance: a4794168-fa1e-43da-a27c-e5e83054dd1e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:00.555875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.556337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.557111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.557541 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.573362 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] HTTP exception thrown: Instance a4794168-fa1e-43da-a27c-e5e83054dd1e could not be found. Nov 19 13:40:00.573873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] Returning 404 to user: Instance a4794168-fa1e-43da-a27c-e5e83054dd1e could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:40:00.574723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-34863baa-9da9-426c-a0ea-b9f0284a498b tempest-ServerRescueNegativeTestJSON-436997543 tempest-ServerRescueNegativeTestJSON-436997543-project] 10.222.0.74 "GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e" status: 404 len: 111 microversion: 2.1 time: 0.032075 Nov 19 13:40:00.575314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 381/756] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:00 2021] GET /compute/v2.1/servers/a4794168-fa1e-43da-a27c-e5e83054dd1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:40:00.580239 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:00.588450 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4adc8e44-4304-4812-9664-f7d904e892fb tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1506 microversion: 2.1 time: 0.159005 Nov 19 13:40:00.589031 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 376/757] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:00 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:00.605629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6dbe09d-7379-42ad-a65c-511c336c2d35", "device": "/dev/sdb"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:00.607348 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:00.613343 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.613788 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:00.614587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:00.615012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:01.493104 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:01.493712 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:01.499784 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:01.500234 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:01.500990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:01.501418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:01.941503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:01.949382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-81bf3206-19c5-476d-9553-a1d2b84fea42 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1663 microversion: 2.1 time: 0.460140 Nov 19 13:40:01.950101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 377/758] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:01 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1663 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:02.942195 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f1b2311a-e099-40b7-91bc-183ea4cadae4 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "POST /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.340438 Nov 19 13:40:02.943155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 382/759] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:40:00 2021] POST /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d/os-volume_attachments => generated 194 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:40:02.966646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:02.967532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:02.979590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:02.980447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:02.981442 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:02.981974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:03.155716 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:03.170064 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8636385a-d0ea-41aa-9b88-cd0cefbde886 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1663 microversion: 2.1 time: 0.206978 Nov 19 13:40:03.171334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 378/760] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:02 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1663 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:04.192456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:04.194582 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:04.202138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:04.202820 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:04.203611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:04.204193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:04.499186 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:04.507712 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-50bdf946-48e7-414d-8e49-c4abdea36a65 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1667 microversion: 2.1 time: 0.322170 Nov 19 13:40:04.520097 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 383/761] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:04 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1667 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:23.264197 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:23.267891 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:23.284145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:23.284741 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:23.285779 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:23.286218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:23.402594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lazy-loading 'services' on Instance uuid 6d12b91a-e989-4541-a158-3f61d7be4b0d {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:40:23.497903 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0b519cde-44ed-40b4-b047-3793dd448c57 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d/os-volume_attachments/e6dbe09d-7379-42ad-a65c-511c336c2d35" status: 202 len: 0 microversion: 2.1 time: 0.237511 Nov 19 13:40:23.499228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 379/762] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:40:23 2021] DELETE /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d/os-volume_attachments/e6dbe09d-7379-42ad-a65c-511c336c2d35 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:40:24.632963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:24.634193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:24.646590 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:24.647114 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:24.647869 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:24.648640 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:24.676026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:40:24.779704 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4aaae475-d2e2-4029-be07-34dd81b4d09e tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 204 len: 0 microversion: 2.1 time: 0.151361 Nov 19 13:40:24.780872 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 384/763] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:40:24 2021] DELETE /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:40:24.793690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:24.794328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:24.800555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:24.801001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:24.801790 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:24.802252 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:24.960848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:24.970899 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5c1f36c1-03d7-414e-886f-308bcb531c84 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1512 microversion: 2.1 time: 0.183289 Nov 19 13:40:24.975786 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 380/764] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:24 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:25.994294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:25.995065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:26.002288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:26.002740 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:26.003587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:26.004000 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:26.199251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:26.209535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-34777ced-6a02-428e-ba98-a2a26fc6307c tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1512 microversion: 2.1 time: 0.218693 Nov 19 13:40:26.220659 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 385/765] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:25 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:27.229097 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:27.231355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:27.244108 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:27.244657 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:27.245542 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:27.246044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:27.273962 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-2cec807e-1b68-4d17-988e-8adaa4fe5b5c req-5dbd2c90-b1a6-40b1-bfda-c2e8c2b7c2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d12b91a-e989-4541-a158-3f61d7be4b0d", "name": "network-vif-deleted", "tag": "07b78e5c-45ba-4349-b0e3-1ba23f341e17"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:27.275811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:40:27.275811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:40:27.293984 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2cec807e-1b68-4d17-988e-8adaa4fe5b5c req-5dbd2c90-b1a6-40b1-bfda-c2e8c2b7c2ab service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:27.295606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2cec807e-1b68-4d17-988e-8adaa4fe5b5c req-5dbd2c90-b1a6-40b1-bfda-c2e8c2b7c2ab service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:27.324425 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-2cec807e-1b68-4d17-988e-8adaa4fe5b5c req-5dbd2c90-b1a6-40b1-bfda-c2e8c2b7c2ab service nova] Creating event network-vif-deleted:07b78e5c-45ba-4349-b0e3-1ba23f341e17 for instance 6d12b91a-e989-4541-a158-3f61d7be4b0d on hv-cinder-81735 Nov 19 13:40:27.348348 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-2cec807e-1b68-4d17-988e-8adaa4fe5b5c req-5dbd2c90-b1a6-40b1-bfda-c2e8c2b7c2ab service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082430 Nov 19 13:40:27.350449 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 386/766] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:40:27.391635 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdffdb934bc42e9aa6c934625cab499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2cb9958b6a458eb2517bc6efab7024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:27.404315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3aa7790a-5684-4620-ab1f-dc85aac73f66 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 200 len: 1470 microversion: 2.1 time: 0.180431 Nov 19 13:40:27.406266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 381/767] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:27 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:28.426675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:28.426675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] [instance: 6d12b91a-e989-4541-a158-3f61d7be4b0d] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:28.435607 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:28.435997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:28.436834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:28.437274 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:28.452799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] HTTP exception thrown: Instance 6d12b91a-e989-4541-a158-3f61d7be4b0d could not be found. Nov 19 13:40:28.453399 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] Returning 404 to user: Instance 6d12b91a-e989-4541-a158-3f61d7be4b0d could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:40:28.454230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a2a4e88c-78e7-4832-932e-4dca80c8ab62 tempest-VolumesSnapshotTestJSON-1304335098 tempest-VolumesSnapshotTestJSON-1304335098-project] 10.222.0.74 "GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d" status: 404 len: 111 microversion: 2.1 time: 0.035617 Nov 19 13:40:28.456286 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 387/768] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:28 2021] GET /compute/v2.1/servers/6d12b91a-e989-4541-a158-3f61d7be4b0d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:40:33.257645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:33.258977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:33.266401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:33.267205 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:33.268460 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:33.269112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:33.301189 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2162a335-eb85-40fc-81f1-af9a7f3893b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments/092e45cd-b690-4b85-84eb-a2a63b121428" status: 200 len: 194 microversion: 2.20 time: 0.047894 Nov 19 13:40:33.308837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 382/769] 10.222.0.74 () {60 vars in 1453 bytes} [Fri Nov 19 13:40:33 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments/092e45cd-b690-4b85-84eb-a2a63b121428 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:40:33.402921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:33.403513 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:33.410045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:33.410500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:33.411396 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:33.411832 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:33.510610 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lazy-loading 'services' on Instance uuid 6d127235-a875-411b-939b-ee6f9b1ae4c1 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:40:33.608297 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3eafc03c-c4fc-44a4-9940-5f3f54f337e4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments/092e45cd-b690-4b85-84eb-a2a63b121428" status: 202 len: 0 microversion: 2.20 time: 0.209107 Nov 19 13:40:33.612244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 388/770] 10.222.0.74 () {60 vars in 1456 bytes} [Fri Nov 19 13:40:33 2021] DELETE /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments/092e45cd-b690-4b85-84eb-a2a63b121428 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:40:33.621098 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:33.622909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:33.636405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:33.638363 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:33.639748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:33.640380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:33.685767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-87b24173-48ee-43df-a74f-343bb5e47b73 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070981 Nov 19 13:40:33.687140 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 383/771] 10.222.0.74 () {60 vars in 1342 bytes} [Fri Nov 19 13:40:33 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:40:34.700644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:34.702115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:34.712912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:34.712912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:34.712912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:34.712912 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:34.745084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a93d5578-8d8f-4bf3-adde-45b9254a4b8f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049708 Nov 19 13:40:34.745660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 389/772] 10.222.0.74 () {60 vars in 1342 bytes} [Fri Nov 19 13:40:34 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:34.834772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:34.837296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:34.852508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:34.853055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:34.853929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:34.854628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:34.883975 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:40:34.977840 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-42599504-8b42-44ad-9c6f-75f6e2e909ea tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 204 len: 0 microversion: 2.20 time: 0.146630 Nov 19 13:40:34.981056 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 384/773] 10.222.0.74 () {60 vars in 1279 bytes} [Fri Nov 19 13:40:34 2021] DELETE /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 13:40:34.989253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:34.990110 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:34.996940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:34.997521 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:34.998330 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:34.998867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:35.158612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:35.176982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:35.179354 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:35.183254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c1161b4b-ccff-459d-a3d4-cbc39cdb12cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.198730 Nov 19 13:40:35.196105 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 390/774] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:34 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:36.207497 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:36.208082 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:36.224601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:36.226348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:36.233016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:36.233752 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:36.580161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:36.589085 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:36.590913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:36.592314 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b5edf9bf-a6f3-4e66-8604-d989adfedde5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.392331 Nov 19 13:40:36.593044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 385/775] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:36 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:37.611526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:37.612030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:37.623065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:37.623529 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:37.627851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:37.628398 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:38.344345 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:38.355624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:38.364312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:38.365880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cb4cef46-ded9-4d74-9cbb-e05383d326c6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1722 microversion: 2.20 time: 0.758504 Nov 19 13:40:38.369508 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 391/776] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:37 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1722 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:39.387966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:39.388587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:39.400011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:39.400467 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:39.401278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:39.404784 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:39.593817 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:39.620208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:39.621836 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-aee9bfa5-0381-48e0-ae34-3af3f1e13268 req-ea1761c8-a5f0-4456-8bf3-4f6c5f2fc256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d127235-a875-411b-939b-ee6f9b1ae4c1", "name": "network-vif-deleted", "tag": "460176f5-444f-4943-867e-6409bf13b153"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:39.624551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:39.625822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:40:39.625822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:40:39.631908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dc07ad9f-bf1e-4860-b2bd-11f2786f7645 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1655 microversion: 2.20 time: 0.247848 Nov 19 13:40:39.647183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 386/777] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:39 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1655 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:39.649776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-aee9bfa5-0381-48e0-ae34-3af3f1e13268 req-ea1761c8-a5f0-4456-8bf3-4f6c5f2fc256 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:39.650442 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-aee9bfa5-0381-48e0-ae34-3af3f1e13268 req-ea1761c8-a5f0-4456-8bf3-4f6c5f2fc256 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:39.670234 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-aee9bfa5-0381-48e0-ae34-3af3f1e13268 req-ea1761c8-a5f0-4456-8bf3-4f6c5f2fc256 service nova] Creating event network-vif-deleted:460176f5-444f-4943-867e-6409bf13b153 for instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 on hv-cinder-81735 Nov 19 13:40:39.677753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-aee9bfa5-0381-48e0-ae34-3af3f1e13268 req-ea1761c8-a5f0-4456-8bf3-4f6c5f2fc256 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064764 Nov 19 13:40:39.678614 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 392/778] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:40:40.650279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:40.651654 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:40.658447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:40.659238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:40.660305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:40.660924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:41.084874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:41.101073 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:41.102705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:41.103956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e8037786-2dec-45af-a2e2-85337d8b4561 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1366 microversion: 2.20 time: 0.457785 Nov 19 13:40:41.104549 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 387/779] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:40 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:42.124223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:42.124982 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:42.137592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:42.138260 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:42.139749 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:42.142115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:42.197956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:42.198542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:42.199130 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lazy-loading 'fault' on Instance uuid 6d127235-a875-411b-939b-ee6f9b1ae4c1 {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:40:42.270772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:42.279595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:42.281533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:42.282856 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-121ba692-044e-4ae5-8936-245c04a68d93 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 200 len: 1371 microversion: 2.20 time: 0.164189 Nov 19 13:40:42.283553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 393/780] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:42 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:43.305797 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:43.306692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:43.323639 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:43.325711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:43.327740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:43.330246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:43.369512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] HTTP exception thrown: Instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 could not be found. Nov 19 13:40:43.370588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Returning 404 to user: Instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:40:43.371771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f2b86403-e4e1-4a6d-a404-62e8539cf91d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 404 len: 111 microversion: 2.20 time: 0.073868 Nov 19 13:40:43.376481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 388/781] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:43 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 13:40:43.382060 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-120f65eb-f3da-4d00-b80a-632e6beed512 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '.version_select at 0x7fb42a55cf70>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:43.506487 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-120f65eb-f3da-4d00-b80a-632e6beed512 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038749566" status: 204 len: 0 microversion: 2.20 time: 0.127674 Nov 19 13:40:43.507527 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 394/782] 10.222.0.74 () {60 vars in 1261 bytes} [Fri Nov 19 13:40:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038749566 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 13:40:44.419460 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a57f5a43-2a7b-4f25-96fc-2591aeff1070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'create', calling method: .version_select at 0x7fb429cab4c0>, body: {"keypair": {"name": "tempest-keypair-2103492664"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:44.448255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-a57f5a43-2a7b-4f25-96fc-2591aeff1070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:40:44.454203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-a57f5a43-2a7b-4f25-96fc-2591aeff1070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for user 4e712519a9d54cee964e57814985b4ab and project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:40:44.574875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-a57f5a43-2a7b-4f25-96fc-2591aeff1070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:40:44.579659 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-a57f5a43-2a7b-4f25-96fc-2591aeff1070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for user 4e712519a9d54cee964e57814985b4ab and project be95e890da954a74b914b3e0aef316c1. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:40:44.600601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a57f5a43-2a7b-4f25-96fc-2591aeff1070 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.181807 Nov 19 13:40:44.617833 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 389/783] 10.222.0.74 () {62 vars in 1198 bytes} [Fri Nov 19 13:40:44 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 13:40:47.209078 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1477798940", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd895079-04e8-47ee-af89-1a706b94b509"}], "security_groups": [{"name": "tempest-securitygroup--1750631846"}], "key_name": "tempest-keypair-2103492664", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:47.375162 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] validate_networks() for [('bd895079-04e8-47ee-af89-1a706b94b509', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:40:47.916776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:40:47.917386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:40:47.918043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:40:47.918587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:40:47.919332 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:40:47.930712 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:47.931223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:47.932382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:47.932843 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:47.951922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for project be95e890da954a74b914b3e0aef316c1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:40:47.957293 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Getting quotas for user 4e712519a9d54cee964e57814985b4ab and project be95e890da954a74b914b3e0aef316c1. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:40:47.984680 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:40:47.987757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:40:48.041150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-78ece8e7-369d-4026-a88e-28b920ee1195 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.837236 Nov 19 13:40:48.042652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 395/784] 10.222.0.74 () {62 vars in 1187 bytes} [Fri Nov 19 13:40:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 13:40:48.053578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-eb006f87-0449-4c14-9d48-023824613869 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:48.054907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-eb006f87-0449-4c14-9d48-023824613869 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:48.126601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eb006f87-0449-4c14-9d48-023824613869 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:48.140300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eb006f87-0449-4c14-9d48-023824613869 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:48.142520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eb006f87-0449-4c14-9d48-023824613869 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:48.150002 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-eb006f87-0449-4c14-9d48-023824613869 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1282 microversion: 2.20 time: 0.095748 Nov 19 13:40:48.150960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 390/785] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:48 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:40:49.180667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:49.181631 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:49.197289 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:49.197904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:49.198863 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:49.199432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:49.300900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:49.322985 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:49.324888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:49.326204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a437d3b6-bc2a-49ca-af1b-25731b4090ca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1342 microversion: 2.20 time: 0.150829 Nov 19 13:40:49.327741 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 396/786] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:49 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:50.357609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:50.358224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:50.371607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:50.372392 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:50.373729 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:50.374352 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:50.615179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:50.625632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:50.628358 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:50.632701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e4448f69-0ab0-4fd4-bc10-9aeeae8a407a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.278660 Nov 19 13:40:50.633857 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 391/787] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:50 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:50.986024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-13a34604-4af2-4d3e-9105-4cddc25e7420 req-c4542c2e-d51d-4b2a-a178-472f0f849c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:50.987538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:40:50.987538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:40:51.008325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-13a34604-4af2-4d3e-9105-4cddc25e7420 req-c4542c2e-d51d-4b2a-a178-472f0f849c15 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:51.013033 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-13a34604-4af2-4d3e-9105-4cddc25e7420 req-c4542c2e-d51d-4b2a-a178-472f0f849c15 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:51.038045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-13a34604-4af2-4d3e-9105-4cddc25e7420 req-c4542c2e-d51d-4b2a-a178-472f0f849c15 service nova] Creating event network-changed:96b4d778-35ca-4bef-a1ed-070e56519720 for instance b6bff66c-4dcd-4ade-9837-55946c611c03 on hv-cinder-81735 Nov 19 13:40:51.043815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-13a34604-4af2-4d3e-9105-4cddc25e7420 req-c4542c2e-d51d-4b2a-a178-472f0f849c15 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061501 Nov 19 13:40:51.044906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 397/788] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:40:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:40:51.654031 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:51.654663 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:51.662306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:51.663345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:51.664441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:51.664930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:51.944187 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:51.955683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:51.957624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:51.959427 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-773c43be-465a-406a-989b-415e3e5a9ac1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.311342 Nov 19 13:40:51.972057 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 392/789] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:51 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:52.980388 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:52.984203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:52.993961 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:52.994394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:52.995584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:52.996169 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:53.170941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:53.180230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:53.182339 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:53.183695 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e40c257e-51bf-4ceb-a615-63c3479a25eb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.209011 Nov 19 13:40:53.184654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 398/790] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:52 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:54.206581 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:54.206581 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:54.216380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:54.216380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:54.216917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:54.217505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:54.337834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-861bbbf1-5ac7-4fd9-a141-a9aff4fd4c13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Action: 'create', calling method: .version_select at 0x7fb42a5524c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2035220342"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:54.369224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-861bbbf1-5ac7-4fd9-a141-a9aff4fd4c13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Getting quotas for project 85281dbfabf143df85af115a347baa81. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:40:54.373658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-861bbbf1-5ac7-4fd9-a141-a9aff4fd4c13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Getting quotas for user ee601659ab344b3db3fdc7226dc6f33a and project 85281dbfabf143df85af115a347baa81. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:40:54.374650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:54.384554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:54.386004 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:54.387145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-098178bd-75e3-431b-93fc-36699d8550a3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.186890 Nov 19 13:40:54.395821 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 393/791] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:54 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:54.524469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-861bbbf1-5ac7-4fd9-a141-a9aff4fd4c13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Getting quotas for project 85281dbfabf143df85af115a347baa81. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:40:54.528338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-861bbbf1-5ac7-4fd9-a141-a9aff4fd4c13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Getting quotas for user ee601659ab344b3db3fdc7226dc6f33a and project 85281dbfabf143df85af115a347baa81. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:40:54.541663 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-861bbbf1-5ac7-4fd9-a141-a9aff4fd4c13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.209102 Nov 19 13:40:54.542268 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 399/792] 10.222.0.74 () {60 vars in 1157 bytes} [Fri Nov 19 13:40:54 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:40:54.654808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1247047141", "imageRef": "354b203a-fbf0-4526-bec6-b5ff857a9129", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2035220342", "networks": [{"uuid": "b9bb08a1-9ff5-42f1-8a77-98c8eea8801f"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:54.711256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] validate_networks() for [('b9bb08a1-9ff5-42f1-8a77-98c8eea8801f', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:40:55.126579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:40:55.127006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:40:55.128745 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:40:55.129324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:40:55.129807 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:40:55.141805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:55.142693 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:55.143647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:55.144159 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:55.163011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Getting quotas for project 85281dbfabf143df85af115a347baa81. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:40:55.167343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Getting quotas for user ee601659ab344b3db3fdc7226dc6f33a and project 85281dbfabf143df85af115a347baa81. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:40:55.178152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:40:55.180481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='354b203a-fbf0-4526-bec6-b5ff857a9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:40:55.231271 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7185af31-82a0-4c51-98ef-933af9895d50 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580419 Nov 19 13:40:55.231954 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 394/793] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:40:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:40:55.242806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-96ad6f5e-3589-4b07-be80-14f8e195c0de tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:55.243791 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-96ad6f5e-3589-4b07-be80-14f8e195c0de tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:55.311328 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-96ad6f5e-3589-4b07-be80-14f8e195c0de tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:55.317885 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-96ad6f5e-3589-4b07-be80-14f8e195c0de tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1259 microversion: 2.1 time: 0.079521 Nov 19 13:40:55.318662 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 400/794] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:55 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:55.405194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:55.406437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:55.413182 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:55.413674 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:55.414483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:55.414922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:55.559195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:55.571007 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:55.572751 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:55.573920 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f8c5633a-00fd-4713-928e-f42b9cbf5689 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.172615 Nov 19 13:40:55.574857 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 395/795] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:55 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:56.337609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:56.338917 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:56.346157 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:56.346690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:56.347782 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:56.348440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:56.419632 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:56.427357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e8d0ba47-2795-45ab-b558-9674d9692875 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1317 microversion: 2.1 time: 0.094944 Nov 19 13:40:56.428352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 401/796] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:56 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1317 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:56.595410 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:56.596278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:56.604750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:56.605659 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:56.606748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:56.607284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:56.772367 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-96fa3fab-5ef3-412c-8242-55d18116466c req-928ee8cf-6960-4b57-8e8c-86d7d4ed2a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "name": "network-vif-plugged", "status": "completed", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:40:56.774226 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:40:56.774226 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:40:56.783957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-96fa3fab-5ef3-412c-8242-55d18116466c req-928ee8cf-6960-4b57-8e8c-86d7d4ed2a73 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:56.784311 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-96fa3fab-5ef3-412c-8242-55d18116466c req-928ee8cf-6960-4b57-8e8c-86d7d4ed2a73 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:56.807789 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-96fa3fab-5ef3-412c-8242-55d18116466c req-928ee8cf-6960-4b57-8e8c-86d7d4ed2a73 service nova] Creating event network-vif-plugged:96b4d778-35ca-4bef-a1ed-070e56519720 for instance b6bff66c-4dcd-4ade-9837-55946c611c03 on hv-cinder-81735 Nov 19 13:40:56.827165 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-96fa3fab-5ef3-412c-8242-55d18116466c req-928ee8cf-6960-4b57-8e8c-86d7d4ed2a73 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058233 Nov 19 13:40:56.828944 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 402/797] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:40:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:40:57.155257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:57.164921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:57.167388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:57.168922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c8c5b10d-3093-45fd-97d3-32f182f641ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.578196 Nov 19 13:40:57.169989 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 396/798] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:56 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:57.450994 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:57.451678 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:57.459191 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:57.459978 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:57.460950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:57.461579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:57.645067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:57.653433 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8b9ba546-b72f-4e28-986b-a0cc5e1cb895 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.211569 Nov 19 13:40:57.654056 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 403/799] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:57 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:58.190306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:58.191216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:58.199060 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:58.199564 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:58.200355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:58.200792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:58.360020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:58.369306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:58.370912 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:58.372146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fe55bbac-a134-46e2-b5ce-1d05824d48e7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.185982 Nov 19 13:40:58.372774 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 397/800] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:58 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:58.674300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:58.674910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:58.683603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:58.684880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:58.685083 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:58.685452 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:58.834195 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:58.841931 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8626779d-6639-40dd-a11e-8d0d34152b9b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.173358 Nov 19 13:40:58.842514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 404/801] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:58 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:40:59.392168 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:59.392739 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:59.399867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:59.400328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:59.401120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:59.401553 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:59.547510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:59.555907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:59.557745 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:40:59.558887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6576f70e-6d8b-482f-8ac7-f05108d493a6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.170593 Nov 19 13:40:59.559466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 398/802] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:40:59 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:40:59.859821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:40:59.860419 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:40:59.867795 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:59.868284 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:40:59.869111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:40:59.869616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:00.026422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:00.037552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-439642cb-332d-4dd9-b6c7-1cc09e42e5d7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.181393 Nov 19 13:41:00.038739 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 405/803] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:40:59 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:00.580519 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:00.581142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:00.588498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:00.588956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:00.589761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:00.590175 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:00.737293 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:00.746516 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:00.748053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:00.749179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e9a2d4e5-a709-40a1-8a78-fa78f13fc246 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.173561 Nov 19 13:41:00.749943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 399/804] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:00 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:01.066866 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:01.067713 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:01.077983 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:01.078430 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:01.079271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:01.079703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:01.223507 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:01.232462 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4fb1f021-c5b5-48f2-8c24-771d84bea74a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.169292 Nov 19 13:41:01.233080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 406/805] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:01 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:01.772704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:01.774041 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:01.779767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:01.780222 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:01.781018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:01.781458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:01.932408 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:01.941164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:01.942756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:01.943900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3f6afebc-0f27-406f-bfd5-10899765a786 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.175414 Nov 19 13:41:01.944476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 400/806] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:01 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:02.250427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:02.251736 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:02.259134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:02.259907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:02.261017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:02.261675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:02.417050 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:02.424727 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-06107d8f-9671-4800-8210-6a4fa6849c5d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.178533 Nov 19 13:41:02.425325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 407/807] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:02 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:02.962421 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:02.964060 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:02.971621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:02.972284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:02.973333 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:02.974157 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:03.335316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:03.350320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:03.351959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:03.353151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3092578c-99e2-402e-960c-4f98fc66945d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.394995 Nov 19 13:41:03.356824 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 401/808] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:02 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:03.441999 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:03.442864 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:03.449618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:03.450076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:03.450871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:03.451348 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:03.596551 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:03.605042 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-66f63cc0-13a3-46da-ac19-52986073f2c7 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.166830 Nov 19 13:41:03.605661 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 408/809] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:03 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:04.378894 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:04.379591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:04.386932 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:04.387414 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:04.388211 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:04.388650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:04.529638 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:04.538759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:04.540291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:04.541488 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ee042396-34eb-4bc6-835b-6b0ca68765e5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.166658 Nov 19 13:41:04.542263 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 402/810] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:04 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:04.622738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:04.623656 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:04.630838 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:04.631341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:04.632127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:04.632560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:04.835999 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:04.843692 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5e0956ac-5c74-4734-a713-0599842947ec tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.225041 Nov 19 13:41:04.844275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 409/811] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:04 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:05.560514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:05.561184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:05.569457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:05.569457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:05.570177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:05.570657 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:05.721713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:05.731113 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:05.732679 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:05.733818 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7aff2a8b-d441-41aa-847e-ef374904cc3e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.177651 Nov 19 13:41:05.734601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 403/812] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:05 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:05.861686 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:05.862309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:05.869051 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:05.869494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:05.870277 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:05.870701 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:06.021301 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:06.029350 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f4e11474-cbe2-44b6-8092-bb609fa16280 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.171403 Nov 19 13:41:06.029951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 410/813] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:05 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:06.753099 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:06.753777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:06.760468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:06.760917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:06.761736 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:06.762153 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:06.980152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:06.989841 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:06.991407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:06.992527 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-32dfab86-3db9-4dce-9170-84d910a4af56 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1408 microversion: 2.20 time: 0.243291 Nov 19 13:41:06.993166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 404/814] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:06 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:07.048624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:07.049464 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:07.057393 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:07.058253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:07.059609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:07.060250 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:07.260146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:07.269809 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6f9c06bd-e981-4981-80ee-df36c83b6f15 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.227489 Nov 19 13:41:07.270406 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 411/815] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:07 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:07.360116 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-89870f4d-74b8-4873-a58c-28908c928998 req-fbe836be-8185-420f-a235-35f13a2ceee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:07.365300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:07.365300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:41:07.381995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-89870f4d-74b8-4873-a58c-28908c928998 req-fbe836be-8185-420f-a235-35f13a2ceee9 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:07.382758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-89870f4d-74b8-4873-a58c-28908c928998 req-fbe836be-8185-420f-a235-35f13a2ceee9 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:07.406366 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-89870f4d-74b8-4873-a58c-28908c928998 req-fbe836be-8185-420f-a235-35f13a2ceee9 service nova] Creating event network-changed:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:41:07.413081 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-89870f4d-74b8-4873-a58c-28908c928998 req-fbe836be-8185-420f-a235-35f13a2ceee9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060237 Nov 19 13:41:07.413874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 405/816] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:08.010340 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:08.010847 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:08.016911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.017371 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.018170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.018595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.109306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:08.110312 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:08.117799 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.118254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.119046 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.119517 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.150094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a6cb672e-e6e1-45fb-8060-0152296c6983 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044757 Nov 19 13:41:08.151025 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 406/817] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:41:08 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:08.209926 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:08.210433 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:08.218045 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.218537 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.219370 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.219811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.246014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:41:08.247329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:08.255812 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:08.257433 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:08.258609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f67fcc3e-3361-49a0-b2e6-9d0610affd9b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1600 microversion: 2.20 time: 0.252321 Nov 19 13:41:08.271268 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 412/818] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:08 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1600 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:08.277201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:08.277787 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:08.285866 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.286359 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.287402 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.287747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.338556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e12e4575-50a2-4f21-982f-a0a292936263 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 204 len: 0 microversion: 2.1 time: 0.132125 Nov 19 13:41:08.339162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 407/819] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:41:08 2021] DELETE /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 13:41:08.344615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:08.345531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:08.353750 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.354539 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.356315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.356783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.398230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1322ce3b-bf15-4136-97da-01f71c6b58f5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124742 Nov 19 13:41:08.398844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 413/820] 10.222.0.74 () {60 vars in 1315 bytes} [Fri Nov 19 13:41:08 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:08.403478 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:08.404278 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:08.429971 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.430428 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.431265 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:08.432050 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:08.649437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:08.657230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:08.658936 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d79a723f-f095-4126-9454-4f78cdacc3b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.318393 Nov 19 13:41:08.660266 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 408/821] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:08 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:08.665566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1aa5bfd9-9afb-4fc7-87d5-3f38635bbbe1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1673 microversion: 2.1 time: 0.265460 Nov 19 13:41:08.675232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 414/822] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:08 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1673 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:09.404759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:09.406395 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:09.407086 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-a29d73b3-2fbe-4970-b8e4-384e31ce6fd8 req-98dbadbf-47ab-4330-ba4b-c85c1fd4d658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:09.408660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:09.408660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:09.414127 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.414643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.415763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.416278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.416513 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a29d73b3-2fbe-4970-b8e4-384e31ce6fd8 req-98dbadbf-47ab-4330-ba4b-c85c1fd4d658 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.416950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-a29d73b3-2fbe-4970-b8e4-384e31ce6fd8 req-98dbadbf-47ab-4330-ba4b-c85c1fd4d658 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.429138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-a29d73b3-2fbe-4970-b8e4-384e31ce6fd8 req-98dbadbf-47ab-4330-ba4b-c85c1fd4d658 service nova] Creating event network-changed:96b4d778-35ca-4bef-a1ed-070e56519720 for instance b6bff66c-4dcd-4ade-9837-55946c611c03 on hv-cinder-81735 Nov 19 13:41:09.435071 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-a29d73b3-2fbe-4970-b8e4-384e31ce6fd8 req-98dbadbf-47ab-4330-ba4b-c85c1fd4d658 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031554 Nov 19 13:41:09.436254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 415/823] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:09.482169 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e5d1bfad-9ac7-4621-b92d-91c173cf137a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.081392 Nov 19 13:41:09.483257 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 409/824] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:09 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:09.679694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:09.680844 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:09.684514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:09.684867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:09.688539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.689073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.689878 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.690308 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.692629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.693512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.694416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:09.694862 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:09.999029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:10.005537 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:10.007526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-730faa97-67de-477c-be23-2661d705a9db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.334401 Nov 19 13:41:10.016616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-56f5a9f9-ce09-483c-a313-7be9bc14fe9a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1673 microversion: 2.1 time: 0.337233 Nov 19 13:41:10.017862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 416/825] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:09 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:10.018324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 410/826] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:09 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1673 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:10.494402 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:10.495688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:10.503274 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:10.504061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:10.504940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:10.505626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:10.579508 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5f245e73-3123-47dc-9802-e5a38a0e7341 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.089368 Nov 19 13:41:10.582653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 417/827] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:10 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:11.025264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:11.025872 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:11.033146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.033629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.034430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.034863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.037140 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:11.037922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:11.045194 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.045951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.046774 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.047232 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.147069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:11.156132 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f06c0cbc-774b-42ac-8cf8-6e323dc478c1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 200 len: 1606 microversion: 2.1 time: 0.123760 Nov 19 13:41:11.164408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 418/828] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:11 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 1606 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:11.308456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-d5e16c31-1478-48d4-8b70-8c26df26df44 req-75807261-6418-44ad-a018-3f1f9df50536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74979cdc-e64b-40da-8cf1-7f6311e51aec", "name": "network-vif-deleted", "tag": "28e689cc-05d4-4dc9-a15e-6b1e27cf47b3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:11.311588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:11.311588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:11.314850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:11.322327 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d5e16c31-1478-48d4-8b70-8c26df26df44 req-75807261-6418-44ad-a018-3f1f9df50536 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.323374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d5e16c31-1478-48d4-8b70-8c26df26df44 req-75807261-6418-44ad-a018-3f1f9df50536 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.337325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-d5e16c31-1478-48d4-8b70-8c26df26df44 req-75807261-6418-44ad-a018-3f1f9df50536 service nova] Creating event network-vif-deleted:28e689cc-05d4-4dc9-a15e-6b1e27cf47b3 for instance 74979cdc-e64b-40da-8cf1-7f6311e51aec on hv-cinder-81735 Nov 19 13:41:11.344107 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-d5e16c31-1478-48d4-8b70-8c26df26df44 req-75807261-6418-44ad-a018-3f1f9df50536 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040025 Nov 19 13:41:11.346750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 419/829] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:11.352028 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c6ed39d2-ed5d-4f9a-a80f-2459da75f33f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.330420 Nov 19 13:41:11.364462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 411/830] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:11 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:11.591696 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:11.592727 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:11.599703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.600444 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.601187 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:11.601612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:11.662257 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7a525758-3892-4ef1-b6f1-0ee6d51681ec tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.075027 Nov 19 13:41:11.665561 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 420/831] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:11 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:12.174039 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:12.174727 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:12.184353 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:12.184645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:12.185509 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:12.185940 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:12.203398 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] HTTP exception thrown: Instance 74979cdc-e64b-40da-8cf1-7f6311e51aec could not be found. Nov 19 13:41:12.204014 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Returning 404 to user: Instance 74979cdc-e64b-40da-8cf1-7f6311e51aec could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:41:12.204848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-61f50c51-14b6-4341-aca8-49e3f28f9e37 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 404 len: 111 microversion: 2.1 time: 0.034621 Nov 19 13:41:12.205630 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 412/832] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:12 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:41:12.214905 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4b5944f1-51bf-4782-83b9-e3db4c1be712 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '.version_select at 0x7fb42a5333a0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:12.238410 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4b5944f1-51bf-4782-83b9-e3db4c1be712 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316648945" status: 202 len: 0 microversion: 2.1 time: 0.027563 Nov 19 13:41:12.239003 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 421/833] 10.222.0.74 () {58 vars in 1217 bytes} [Fri Nov 19 13:41:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316648945 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:12.370439 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:12.371480 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:12.377796 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:12.378295 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:12.379216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:12.379802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:12.674244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:12.676200 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:12.683670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:12.684411 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:12.690638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:12.691119 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:12.752512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-270962b1-2680-496f-b236-8850577c2624 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.082365 Nov 19 13:41:12.756738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 422/834] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:12 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:12.888208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:12.899141 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-33d1fa5b-7940-42ad-9a5c-5af443d745f6 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.532197 Nov 19 13:41:12.899754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 413/835] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:12 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:12.994882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-023d5ec9-0864-4d3b-b7fb-71be680db26c req-d5884901-fd20-457e-9df7-50b8a6303f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "name": "network-vif-plugged", "status": "completed", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:12.996638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:12.996638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:13.005629 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-023d5ec9-0864-4d3b-b7fb-71be680db26c req-d5884901-fd20-457e-9df7-50b8a6303f2b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:13.006206 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-023d5ec9-0864-4d3b-b7fb-71be680db26c req-d5884901-fd20-457e-9df7-50b8a6303f2b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:13.017665 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-023d5ec9-0864-4d3b-b7fb-71be680db26c req-d5884901-fd20-457e-9df7-50b8a6303f2b service nova] Creating event network-vif-plugged:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:41:13.023035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-023d5ec9-0864-4d3b-b7fb-71be680db26c req-d5884901-fd20-457e-9df7-50b8a6303f2b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Nov 19 13:41:13.023806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 423/836] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:13.300923 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-28ab9586-5afb-4c9e-a957-0c20152a01c3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: .version_select at 0x7fb429cccb80>, body: {"keypair": {"name": "tempest-keypair-1216809709"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:13.316034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-28ab9586-5afb-4c9e-a957-0c20152a01c3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:41:13.320260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-28ab9586-5afb-4c9e-a957-0c20152a01c3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for user 61c357c1b48a4305bce5451ee68de6e4 and project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:41:13.514684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-28ab9586-5afb-4c9e-a957-0c20152a01c3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:41:13.518305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-28ab9586-5afb-4c9e-a957-0c20152a01c3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for user 61c357c1b48a4305bce5451ee68de6e4 and project 5a84768546e2479ab48c55cca9d00d88. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:41:13.532143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-28ab9586-5afb-4c9e-a957-0c20152a01c3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.235386 Nov 19 13:41:13.532755 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 414/837] 10.222.0.74 () {60 vars in 1157 bytes} [Fri Nov 19 13:41:13 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:13.764620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:13.765588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:13.773089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:13.773684 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:13.774500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:13.774935 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:13.839877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-870081a3-d1e1-4c76-9664-ba89c92febc3 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.079328 Nov 19 13:41:13.843191 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 424/838] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:13 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:13.915795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:13.916733 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:13.923999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:13.924451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:13.925289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:13.925722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:14.065260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:14.073522 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1bbf5e19-87cd-4468-bc6e-43ac26c5775d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1359 microversion: 2.1 time: 0.161472 Nov 19 13:41:14.074451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 415/839] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:13 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:14.851879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:14.852885 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:14.859991 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:14.860446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:14.861280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:14.861761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:14.905683 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-747399641", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e8d3ce8-6200-409f-8036-c10d558c4d7e"}], "security_groups": [{"name": "tempest-securitygroup--801304072"}], "key_name": "tempest-keypair-1216809709", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:14.926548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5143eede-a248-4788-8b03-03914bf0b804 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.077964 Nov 19 13:41:14.927539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 425/840] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:14 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:15.022116 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] validate_networks() for [('2e8d3ce8-6200-409f-8036-c10d558c4d7e', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:41:15.091748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:15.092725 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:15.101183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.101749 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.102664 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.103154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.303685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:15.311627 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d600a4bc-f32d-4a5b-a6ac-21b3d0adf697 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1548 microversion: 2.1 time: 0.224962 Nov 19 13:41:15.312233 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 426/841] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:15 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1548 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:15.328171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:15.328771 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:15.334851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.335329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.336117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.336579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.597954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:15.605690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b2df76de-5bcb-4547-90d3-eca6b6733c9d tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1548 microversion: 2.1 time: 0.280899 Nov 19 13:41:15.606265 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 427/842] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:15 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1548 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:15.622960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:15.626829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:15.626829 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:15.627400 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:15.628190 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Searching by: {'deleted': False, 'project_id': '85281dbfabf143df85af115a347baa81'} {{(pid=122814) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 19 13:41:15.629602 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:41:15.630597 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:41:15.631359 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:41:15.631766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:41:15.632149 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:41:15.636208 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.636674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.637552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.637987 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.642042 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.642509 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.643345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.643893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.663823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for project 5a84768546e2479ab48c55cca9d00d88. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:41:15.669196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Getting quotas for user 61c357c1b48a4305bce5451ee68de6e4 and project 5a84768546e2479ab48c55cca9d00d88. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:41:15.683419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:41:15.685898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:41:15.731806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.multi_cell_list [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122814) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 19 13:41:15.738077 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5f9d52f8-6a17-4211-ae44-d8dd07284344 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.838018 Nov 19 13:41:15.739038 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 416/843] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:41:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 13:41:15.749671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-042394af-5c76-48b8-aa69-fcf2313d8280 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:15.750279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-042394af-5c76-48b8-aa69-fcf2313d8280 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:15.809951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-042394af-5c76-48b8-aa69-fcf2313d8280 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:15.817671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-042394af-5c76-48b8-aa69-fcf2313d8280 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1237 microversion: 2.1 time: 0.071553 Nov 19 13:41:15.818600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 417/844] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:15 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:15.838540 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-05976803-b8fb-45c1-a954-2d834dfcc50a tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219949 Nov 19 13:41:15.839150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 428/845] 10.222.0.74 () {58 vars in 1124 bytes} [Fri Nov 19 13:41:15 2021] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:15.850180 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:15.850792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:15.857956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.858407 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.859230 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.859671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.938198 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:15.939146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:15.946638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.947142 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:15.947970 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:15.948403 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:16.008402 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:16.013966 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cb63574a-cd63-46be-8fd7-320493f3e26e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.079399 Nov 19 13:41:16.017273 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 429/846] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:15 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:41:16.020951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-25a3faf0-41e4-4f65-930d-3095cc6eb4bb tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1548 microversion: 2.1 time: 0.170756 Nov 19 13:41:16.020951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 418/847] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:15 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:16.839071 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:16.839843 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:16.846528 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:16.846979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:16.847821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:16.848248 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:16.925509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:16.938364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1e5325ed-4283-4b89-a595-18146807aa84 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1289 microversion: 2.1 time: 0.105634 Nov 19 13:41:16.939167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 430/848] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:16 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:17.028240 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:17.030001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:17.037180 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:17.037625 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:17.038421 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:17.038855 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:17.100639 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-04812c20-d0d8-4655-9547-05003cc9d8ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.078718 Nov 19 13:41:17.105469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 419/849] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:17 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:17.572061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db0cc681-9101-48bf-90d8-974729ccf8ed"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:17.573290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:17.579779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:17.580305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:17.581157 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:17.581592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:17.871519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ba8eb831-113d-4c44-ae09-ef500dcab618 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303421 Nov 19 13:41:17.877335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 431/850] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:41:17 2021] POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:17.965495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:17.966721 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:17.974294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:17.974696 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:17.975583 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:17.976228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:18.112522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:18.113640 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:18.121446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:18.121892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:18.122716 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:18.123512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:18.183900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8566177b-de97-4222-b33a-db5d67578277 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.075852 Nov 19 13:41:18.187246 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 432/851] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:18 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:18.215374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:18.225685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bc7277ec-ef80-4431-a651-00de6fad0fe7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.265128 Nov 19 13:41:18.226273 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 420/852] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:17 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:18.567251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-9541deb2-ac3b-42b7-8ef8-c7fba62beeae req-101e87e2-0a0c-4a01-a907-aeab99cd456d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940a641e-0c00-4c96-b29f-92bd6a3514ad", "tag": "b2bd181d-30d4-41e4-a9e9-27005b9e68f3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:18.569007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:18.569007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:18.577837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-9541deb2-ac3b-42b7-8ef8-c7fba62beeae req-101e87e2-0a0c-4a01-a907-aeab99cd456d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:18.578275 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-9541deb2-ac3b-42b7-8ef8-c7fba62beeae req-101e87e2-0a0c-4a01-a907-aeab99cd456d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:18.598314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-9541deb2-ac3b-42b7-8ef8-c7fba62beeae req-101e87e2-0a0c-4a01-a907-aeab99cd456d service nova] Creating event network-changed:b2bd181d-30d4-41e4-a9e9-27005b9e68f3 for instance 940a641e-0c00-4c96-b29f-92bd6a3514ad on hv-cinder-81735 Nov 19 13:41:18.608373 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-9541deb2-ac3b-42b7-8ef8-c7fba62beeae req-101e87e2-0a0c-4a01-a907-aeab99cd456d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045102 Nov 19 13:41:18.609025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 433/853] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:19.196176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:19.197296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:19.204070 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:19.204603 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:19.205459 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:19.205969 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:19.248285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:19.249154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:19.256631 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:19.257079 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:19.257890 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:19.258329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:19.270089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-566f9664-ffee-4c42-94e1-c226e5c29b49 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.078481 Nov 19 13:41:19.274218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 421/854] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:19 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:19.463478 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:19.471304 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-de19aef6-0ee3-4a48-8333-f2ff2c968fce tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.227575 Nov 19 13:41:19.471895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 434/855] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:19 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:41:20.283227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:20.284165 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:20.291703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:20.292183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:20.292988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:20.293396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:20.361675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7b2e3d36-c4bf-4493-9e72-e2f08e190d7c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 14 microversion: 2.20 time: 0.082204 Nov 19 13:41:20.362541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 422/856] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:20 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:20.492801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:20.493375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:20.500347 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:20.500799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:20.501573 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:20.502013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:20.655324 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:20.662839 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-dd01d0a8-a1be-49aa-ac46-8deb76ddcdf0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.174145 Nov 19 13:41:20.663450 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 435/857] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:20 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:21.491907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:21.492865 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:21.501974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:21.502744 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:21.503534 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:21.504039 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:21.580754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0c3f61bf-b354-4cee-8060-6f513bf85096 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 11454 microversion: 2.20 time: 0.209677 Nov 19 13:41:21.581380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 423/858] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:21 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 11454 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:21.683342 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:21.683991 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:21.690786 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:21.691273 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:21.692078 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:21.692496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:21.918401 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:21.929011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-340c5992-c498-4e18-89cd-fd0393efa61f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.251747 Nov 19 13:41:21.929814 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 436/859] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:21 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:22.597568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:22.598758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:22.607448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:22.607933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:22.608756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:22.609194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:22.684354 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f7b8a433-db72-4792-b9a0-ea820ad7e74e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 18608 microversion: 2.20 time: 0.092682 Nov 19 13:41:22.684955 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 424/860] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:22 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 18608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:22.947002 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:22.947641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:22.954572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:22.955021 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:22.955840 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:22.956270 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:23.110980 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:23.119077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cba8585e-1c48-4486-920d-d4c9dcca7c27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.175671 Nov 19 13:41:23.119681 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 437/861] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:22 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:23.697290 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:23.698320 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:23.705555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:23.705994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:23.706752 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:23.707209 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:23.792966 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-518a4f10-c6a7-4506-a8c1-76d1c9e0b761 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 19133 microversion: 2.20 time: 0.099853 Nov 19 13:41:23.793759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 425/862] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:23 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 19133 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:24.136976 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:24.137585 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:24.144576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:24.145030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:24.145846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:24.146281 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:24.301287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:24.308039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-80d68612-735e-4a51-ae39-98ef8d139acd tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.174777 Nov 19 13:41:24.308722 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 438/863] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:24 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:41:24.806427 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:24.807554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:24.814626 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:24.815078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:24.815890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:24.816325 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:24.890027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-62b7dfa0-500d-414b-a99e-d016a7f45224 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 21226 microversion: 2.20 time: 0.087621 Nov 19 13:41:24.890962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 426/864] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:24 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 21226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:24.941202 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-8aaaa227-a9a8-4df5-8642-42dfa8ced3eb req-946eed03-306e-482c-8f34-93cb215c9f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940a641e-0c00-4c96-b29f-92bd6a3514ad", "name": "network-vif-plugged", "status": "completed", "tag": "b2bd181d-30d4-41e4-a9e9-27005b9e68f3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:24.943066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:24.943066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:24.950724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-8aaaa227-a9a8-4df5-8642-42dfa8ced3eb req-946eed03-306e-482c-8f34-93cb215c9f2c service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:24.952064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-8aaaa227-a9a8-4df5-8642-42dfa8ced3eb req-946eed03-306e-482c-8f34-93cb215c9f2c service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:24.963503 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-8aaaa227-a9a8-4df5-8642-42dfa8ced3eb req-946eed03-306e-482c-8f34-93cb215c9f2c service nova] Creating event network-vif-plugged:b2bd181d-30d4-41e4-a9e9-27005b9e68f3 for instance 940a641e-0c00-4c96-b29f-92bd6a3514ad on hv-cinder-81735 Nov 19 13:41:24.969233 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-8aaaa227-a9a8-4df5-8642-42dfa8ced3eb req-946eed03-306e-482c-8f34-93cb215c9f2c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Nov 19 13:41:24.969853 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 439/865] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:25.326914 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:25.328034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:25.335302 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:25.335766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:25.336561 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:25.336978 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:25.473839 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:25.474549 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:25.481161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:25.481983 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:25.482465 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:25.483566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:25.484016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:25.489160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0b37acef-7cc2-4566-81c1-32a36eb4c717 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.166842 Nov 19 13:41:25.489760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 427/866] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:25 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:25.641028 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:25.648921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ed033a47-7f63-494b-acd6-ea24f9ad9f8e tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1594 microversion: 2.1 time: 0.179206 Nov 19 13:41:25.649489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 440/867] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:25 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1594 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:25.901728 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:25.902667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:25.909570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:25.910008 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:25.910791 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:25.911253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:25.987175 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6ac6941c-4e62-465e-b2d8-baa4fccadd04 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 22981 microversion: 2.20 time: 0.089601 Nov 19 13:41:25.991380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 428/868] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:25 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 22981 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:26.505979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:26.506596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:26.514227 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:26.514787 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:26.515812 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:26.516425 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:26.670110 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:26.679004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9fe529fd-522e-48cf-81ae-193a86ed7e1b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1362 microversion: 2.1 time: 0.176912 Nov 19 13:41:26.679616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 441/869] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:26 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:26.999923 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:27.001039 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:27.010338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.010798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:27.011648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.012072 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:27.088717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-19ff1498-8d1d-4eb9-909e-3f4fc8d17321 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 23804 microversion: 2.20 time: 0.092592 Nov 19 13:41:27.092692 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 429/870] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:26 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 23804 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:27.696743 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:27.697562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:27.704272 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.704816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:27.705993 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.706395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:27.847196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-cafc998c-2c9a-499d-ba99-4db2c4f626b5 req-528789bb-f584-4f0e-939d-a35407a27f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:27.848871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:27.848871 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:41:27.857695 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-cafc998c-2c9a-499d-ba99-4db2c4f626b5 req-528789bb-f584-4f0e-939d-a35407a27f44 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.858377 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-cafc998c-2c9a-499d-ba99-4db2c4f626b5 req-528789bb-f584-4f0e-939d-a35407a27f44 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:27.869545 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-cafc998c-2c9a-499d-ba99-4db2c4f626b5 req-528789bb-f584-4f0e-939d-a35407a27f44 service nova] Creating event network-changed:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:41:27.874783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-cafc998c-2c9a-499d-ba99-4db2c4f626b5 req-528789bb-f584-4f0e-939d-a35407a27f44 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096128 Nov 19 13:41:27.875396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 430/871] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:27.895141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:27.903884 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-540b94a0-d50d-4f85-8c68-9771b17a7ffa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1549 microversion: 2.1 time: 0.210953 Nov 19 13:41:27.904446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 442/872] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:27 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:27.925303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:27.926060 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:27.932980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.933518 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:27.934784 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:27.935327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:28.103416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:28.104376 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:28.115633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:28.128837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:28.130238 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:28.130873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:28.135873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ee327991-2bd3-4c91-b7ce-8aa77a3d850f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214672 Nov 19 13:41:28.143298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 431/873] 10.222.0.74 () {58 vars in 1274 bytes} [Fri Nov 19 13:41:27 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:28.237639 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3aa2c4b3-dc03-4a60-be0b-09e1c0d5dd87 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 25041 microversion: 2.20 time: 0.138654 Nov 19 13:41:28.241851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 443/874] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:28 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 25041 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:29.088306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1179538722"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:29.089065 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:29.096316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:29.097079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:29.097993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:29.098665 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:29.249648 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:29.250758 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:29.258009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:29.258440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:29.259302 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:29.259740 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:29.346101 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0c4c2b78-007a-4b8f-bafc-c58c8982101f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 26448 microversion: 2.20 time: 0.100483 Nov 19 13:41:29.346751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 444/875] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:29 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 26448 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:29.490441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.network.security_group_api [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Adding security group 15636211-33b7-4acd-8d2d-bacf82528983 to port 2ae72a4b-e531-4747-b7bd-e16df6dee43f Nov 19 13:41:30.363355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:30.365059 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:30.374396 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.376117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.377239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.378070 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.396890 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-768d6e93-295d-430e-87b6-fa899e6d0d25 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/action" status: 202 len: 0 microversion: 2.1 time: 1.312575 Nov 19 13:41:30.397672 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 432/876] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:29 2021] POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/action => generated 0 bytes in 1314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:30.406899 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:30.408496 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:30.414660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.415133 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.415940 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.416380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.471192 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a65249a2-92a9-4f26-9eaa-803d9c065779 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 27383 microversion: 2.20 time: 0.111318 Nov 19 13:41:30.475572 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 445/877] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:30 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 27383 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:30.482952 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-b4397022-0914-44e1-8fa9-5aab30bc714d req-0368caea-9d58-4591-a60a-c863ddc882fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:30.484972 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:30.484972 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:30.506523 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-b4397022-0914-44e1-8fa9-5aab30bc714d req-0368caea-9d58-4591-a60a-c863ddc882fa service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.506995 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-b4397022-0914-44e1-8fa9-5aab30bc714d req-0368caea-9d58-4591-a60a-c863ddc882fa service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.524548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-b4397022-0914-44e1-8fa9-5aab30bc714d req-0368caea-9d58-4591-a60a-c863ddc882fa service nova] Creating event network-changed:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:41:30.530915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-b4397022-0914-44e1-8fa9-5aab30bc714d req-0368caea-9d58-4591-a60a-c863ddc882fa service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056231 Nov 19 13:41:30.532064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 446/878] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:30.577670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:30.579223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:30.586314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.587055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.588049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:30.588633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:30.665568 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c565da60-938b-4451-a262-cfefb8133ae7 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.099721 Nov 19 13:41:30.666315 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 447/879] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:30 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:30.678875 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:30.688962 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8c4c443b-0120-49b4-ae43-0a2d2c7d7893 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1760 microversion: 2.1 time: 0.286441 Nov 19 13:41:30.689537 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 433/880] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:30 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1760 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:31.484127 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:31.485143 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:31.493857 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:31.494337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:31.495129 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:31.495601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:31.590370 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-448f859a-139c-4486-a2e8-6bbfa6f4fc9c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 27863 microversion: 2.20 time: 0.110139 Nov 19 13:41:31.591366 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 448/881] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:31 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 27863 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:31.677401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:31.678380 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:31.685606 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:31.686239 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:31.686836 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:31.687311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:31.746278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1971dd8c-d214-4df7-801b-61676ecd012b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.072748 Nov 19 13:41:31.746924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 434/882] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:31 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:32.603506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:32.604562 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:32.612303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:32.612886 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:32.613998 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:32.614596 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:32.619814 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-ab774809-bef3-4a27-94af-049741710c26 req-c5ccfd86-3b8b-4085-9a19-be0cae195d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940a641e-0c00-4c96-b29f-92bd6a3514ad", "tag": "b2bd181d-30d4-41e4-a9e9-27005b9e68f3"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:32.621576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:41:32.621576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:41:32.631456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ab774809-bef3-4a27-94af-049741710c26 req-c5ccfd86-3b8b-4085-9a19-be0cae195d40 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:32.631886 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-ab774809-bef3-4a27-94af-049741710c26 req-c5ccfd86-3b8b-4085-9a19-be0cae195d40 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:32.642644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-ab774809-bef3-4a27-94af-049741710c26 req-c5ccfd86-3b8b-4085-9a19-be0cae195d40 service nova] Creating event network-changed:b2bd181d-30d4-41e4-a9e9-27005b9e68f3 for instance 940a641e-0c00-4c96-b29f-92bd6a3514ad on hv-cinder-81735 Nov 19 13:41:32.647732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-ab774809-bef3-4a27-94af-049741710c26 req-c5ccfd86-3b8b-4085-9a19-be0cae195d40 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103180 Nov 19 13:41:32.648355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 449/883] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:41:32.713863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7475e440-b6ef-445b-aebe-006331c2991e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28174 microversion: 2.20 time: 0.114974 Nov 19 13:41:32.714922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 435/884] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:32 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28174 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:32.757934 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:32.758940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:32.765587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:32.766028 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:32.766837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:32.767330 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:32.830635 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bc0a9b6d-73e6-4b36-989c-5ea074d2f71b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.077112 Nov 19 13:41:32.831355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 450/885] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:32 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:33.731514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:33.733079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:33.741865 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:33.742324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:33.743137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:33.743591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:33.813989 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d4751e49-b891-42b7-9177-396218408926 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28174 microversion: 2.20 time: 0.089477 Nov 19 13:41:33.814658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 436/886] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:33 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28174 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:33.842519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:33.843547 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:33.853494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:33.853930 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:33.854773 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:33.855215 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:33.921496 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-53a821b1-f8bb-4a76-a06e-d0be312a153d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.082838 Nov 19 13:41:33.922135 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 451/887] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:33 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:34.829213 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:34.830416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:34.837660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:34.838119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:34.838922 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:34.839393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:34.920437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a61c2427-ee0d-452c-9dfb-c906956c71c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28465 microversion: 2.20 time: 0.094781 Nov 19 13:41:34.920913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 437/888] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:34 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28465 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:34.939365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:34.941083 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:34.950739 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:34.951221 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:34.952408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:34.952849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:35.013213 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-72db6526-9b69-4060-985f-9ca29766f06c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.079538 Nov 19 13:41:35.013967 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 452/889] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:34 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:35.933514 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:35.934530 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:35.942166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:35.942621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:35.943452 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:35.943880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:36.025512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-97dc7f0e-98dd-4918-b070-ef91c4d545f9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28633 microversion: 2.20 time: 0.096330 Nov 19 13:41:36.026193 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 438/890] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:35 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28633 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:36.026902 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:36.028056 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:36.035466 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:36.035916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:36.036730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:36.037167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:36.100231 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ec534b6b-eea3-47ac-befb-ebd6e4d0342e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.077347 Nov 19 13:41:36.100876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 453/891] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:36 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:37.042119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:37.043167 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:37.050959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:37.051449 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:37.052258 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:37.052703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:37.111998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:37.113014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:37.120097 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:37.120539 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3dc4e6ba-e26e-46bb-b9a9-d3f16ea8d9ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28633 microversion: 2.20 time: 0.086023 Nov 19 13:41:37.120671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:37.121208 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 439/892] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:37 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28633 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:37.121474 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:37.121941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:37.194138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-af1605d4-0399-4daa-91d1-b2bad4267fea tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.086122 Nov 19 13:41:37.194769 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 454/893] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:37 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:38.134265 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:38.135334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:38.143169 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:38.143668 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:38.144489 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:38.144930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:38.206309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:38.207387 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:38.214755 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:38.215365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:38.216164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:38.216594 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:38.224959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-225337e7-cd40-4120-93c9-65db71a261d5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28633 microversion: 2.20 time: 0.095368 Nov 19 13:41:38.225608 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 440/894] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:38 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28633 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:38.281034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cc533712-ed53-4c9a-842b-bfaeca7f0873 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.078880 Nov 19 13:41:38.281658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 455/895] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:38 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:39.238173 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:39.239201 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:39.246557 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:39.247023 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:39.247850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:39.248294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:39.293512 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:39.294503 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:39.301828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:39.302482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:39.303305 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:39.303739 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:39.328167 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bc5e8b6e-d2d7-4c3a-a0c7-06b8502f87d1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 28787 microversion: 2.20 time: 0.094147 Nov 19 13:41:39.328820 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 441/896] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:39 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 28787 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:39.373212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b57487e8-32fe-467e-93c3-fc1d1cccc787 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 14 microversion: 2.1 time: 0.083704 Nov 19 13:41:39.373904 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 456/897] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:39 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:41:40.340796 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:40.341797 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:40.349249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:40.349701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:40.350508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:40.350940 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:40.385416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:40.386431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:40.393666 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:40.394133 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:40.394922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:40.395381 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:40.434415 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-170913a2-cd00-4f92-829d-61dbf65ad370 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 30389 microversion: 2.20 time: 0.097636 Nov 19 13:41:40.435085 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 442/898] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:40 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 30389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:40.474990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a1e540d3-8829-43e7-b4ed-8297ec3c750b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 2457 microversion: 2.1 time: 0.093656 Nov 19 13:41:40.475659 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 457/899] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:40 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 2457 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:41.447293 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:41.448238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:41.455760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:41.456224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:41.457040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:41.457473 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:41.486937 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:41.488004 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:41.495428 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:41.495867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:41.496772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:41.497456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:41.546574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f075d8f4-92ae-403c-ae1b-d723cd2c3a0f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 31630 microversion: 2.20 time: 0.103385 Nov 19 13:41:41.547233 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 443/900] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:41 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 31630 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:41.605715 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-58841fa9-dcee-4912-a05e-79652fb83646 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 12459 microversion: 2.1 time: 0.122800 Nov 19 13:41:41.606379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 458/901] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:41 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 12459 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:42.559795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:42.560803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:42.568524 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:42.568981 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:42.569784 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:42.570209 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:42.618156 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:42.619113 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:42.627163 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:42.627652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:42.628460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:42.628895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:42.656684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cd9431f1-848e-42a2-ad59-0f89de2ba98e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 33047 microversion: 2.20 time: 0.101288 Nov 19 13:41:42.658049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 444/902] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:42 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 33047 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:42.705521 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f2a226ef-bb63-4500-a31f-79f03b91295f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 18305 microversion: 2.1 time: 0.091148 Nov 19 13:41:42.706160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 459/903] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:42 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 18305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:43.669302 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:43.670312 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:43.677762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:43.678216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:43.679006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:43.679479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:43.718074 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:43.719044 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:43.726435 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:43.726879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:43.727699 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:43.728239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:43.768430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c4fdf6a9-6d30-4fea-9ef5-deece81cf7c8 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 33993 microversion: 2.20 time: 0.103149 Nov 19 13:41:43.769101 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 445/904] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:43 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 33993 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:43.812952 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5cd1bb01-e13c-4a5b-bf23-76eb314f4705 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 18817 microversion: 2.1 time: 0.098578 Nov 19 13:41:43.813825 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 460/905] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:43 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 18817 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:41:44.781382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:44.782493 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:44.790754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:44.791253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:44.792063 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:44.792464 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:44.825538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:44.826542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:44.834117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:44.834564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:44.835389 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:44.835818 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:44.875977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-58e9591d-0481-4286-8f12-fdfda3e5e6cb tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 34713 microversion: 2.20 time: 0.099053 Nov 19 13:41:44.876861 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 446/906] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:44 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 34713 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:44.916854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4a53cd63-6d0f-45bc-95ca-9c7b4bd716a8 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 20997 microversion: 2.1 time: 0.095248 Nov 19 13:41:44.917506 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 461/907] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:44 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 20997 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:45.889151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:45.890823 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:45.898671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:45.899175 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:45.900016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:45.900462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:45.929721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:45.931204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:45.938564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:45.939002 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:45.940399 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:45.940835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:45.988420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c6248041-8b70-487c-99bf-0562aa5c4429 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 35560 microversion: 2.20 time: 0.103129 Nov 19 13:41:45.989186 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 447/908] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:45 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 35560 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:46.035389 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-74d69574-dd2d-4683-af05-2e657689516f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 22948 microversion: 2.1 time: 0.109381 Nov 19 13:41:46.035710 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 462/909] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:45 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 22948 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:47.004350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:47.005561 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:47.013144 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:47.013631 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:47.014428 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:47.014869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:47.049052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:47.050622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:47.061415 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:47.062073 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:47.062855 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:47.063389 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:47.093035 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d3459b03-1753-4cfd-a6bb-c1b5b8f862cf tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 36797 microversion: 2.20 time: 0.093772 Nov 19 13:41:47.093730 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 448/910] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:46 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 36797 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:47.141153 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-bd162f70-e028-4a6b-a696-e6fec3a4c21f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 23803 microversion: 2.1 time: 0.097208 Nov 19 13:41:47.142019 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 463/911] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:47 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 23803 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:48.111398 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:48.113080 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:48.125067 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:48.125828 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:48.127156 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:48.127916 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:48.154532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:48.155700 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:48.162978 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:48.163460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:48.164271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:48.164705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:48.206088 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cca61343-9f2a-4635-9f20-a970205cbf9f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 38044 microversion: 2.20 time: 0.101689 Nov 19 13:41:48.206758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 449/912] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:48 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 38044 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:48.252269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-55a2c361-83b6-4459-a36d-06f59f80684a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 25020 microversion: 2.1 time: 0.101648 Nov 19 13:41:48.252915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 464/913] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:48 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 25020 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:49.218987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:49.220018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:49.227731 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:49.228179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:49.228995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:49.229426 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:49.266537 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:49.267579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:49.276005 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:49.276418 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:49.277588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:49.278040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:49.304830 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2760e259-3c17-4381-9d2e-af23f88d3ee1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 38187 microversion: 2.20 time: 0.089798 Nov 19 13:41:49.305878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 450/914] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:49 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 38187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:49.358084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1f9ebdea-2f95-4bcb-b6f7-3f58ecb489e0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 26284 microversion: 2.1 time: 0.096664 Nov 19 13:41:49.360146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 465/915] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:49 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 26284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:50.321261 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:50.322527 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:50.331649 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:50.332103 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:50.332898 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:50.333329 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:50.370892 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:50.371923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:50.379196 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:50.379672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:50.380459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:50.380890 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:50.400883 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-da5da794-b3d1-48b9-9ae1-1997eccf4998 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 38187 microversion: 2.20 time: 0.086038 Nov 19 13:41:50.401551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 451/916] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:50 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 38187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:50.458337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f61665db-cc0d-4b84-be6b-e63d83b9c182 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 27212 microversion: 2.1 time: 0.091233 Nov 19 13:41:50.459053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 466/917] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:50 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 27212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:51.414883 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:51.415799 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:51.423082 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:51.423566 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:51.424371 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:51.424825 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:51.470655 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:51.471823 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:51.480141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:51.480586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:51.481379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:51.481954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:51.491774 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c12a9722-8f9a-4832-9397-53881e4a6e40 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 38187 microversion: 2.20 time: 0.081414 Nov 19 13:41:51.492796 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 452/918] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:51 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 38187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:51.573909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f199b666-2e4a-42d3-baa5-fe203c0dc1f4 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 27651 microversion: 2.1 time: 0.107209 Nov 19 13:41:51.574798 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 467/919] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:51 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 27651 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:52.505620 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:52.506643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:52.514425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:52.514894 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:52.515702 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:52.516137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:52.592647 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:52.593669 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:52.597291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-32c9f9dd-baa0-4023-9277-be6fa33839c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 200 len: 38330 microversion: 2.20 time: 0.095557 Nov 19 13:41:52.603267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 453/920] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:52 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 38330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:52.603477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:52.603477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:52.603477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:52.603477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:52.609751 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:52.610256 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:52.618204 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:52.618661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:52.619501 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:52.619951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:52.650605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6d5fc2b5-7437-47ff-8478-20f19e9d798d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/ips" status: 200 len: 151 microversion: 2.20 time: 0.045105 Nov 19 13:41:52.650605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 454/921] 10.222.0.74 () {60 vars in 1288 bytes} [Fri Nov 19 13:41:52 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:52.690312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-68d47d69-4ca3-4a3b-a5d7-9b2f00e69fe2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28204 microversion: 2.1 time: 0.103130 Nov 19 13:41:52.690974 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 468/922] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:52 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:41:53.303942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:53.305041 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:53.313536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:53.314214 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:53.315118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:53.315587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:53.407154 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3c50e932-ff8a-4f94-820b-52eb7268e1c9 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.107009 Nov 19 13:41:53.407944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 455/923] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:53 2021] POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:41:53.416445 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:53.417214 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:53.427029 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:53.427718 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:53.428588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:53.429057 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:53.692686 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:53.701873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d12c7e67-cc45-4a26-b460-403888d38929 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1752 microversion: 2.1 time: 0.289534 Nov 19 13:41:53.703068 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:53.704164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:53.704606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 469/924] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:53 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:53.711228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:53.711648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:53.712677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:53.713114 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:53.775979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c7e5bdd5-814f-44a7-9e04-abe12a672c57 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28204 microversion: 2.1 time: 0.077362 Nov 19 13:41:53.776609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 456/925] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:53 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28204 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:41:54.719618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:54.720190 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:54.727230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:54.727658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:54.728440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:54.728867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:54.788685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:54.789686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:54.797555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:54.798010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:54.798802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:54.799316 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:54.877701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a5d63f13-63e9-4f3d-ac3e-100df443a274 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28495 microversion: 2.1 time: 0.093251 Nov 19 13:41:54.878371 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 457/926] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:54 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28495 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:54.883552 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:54.884161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:54.885030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:54.891388 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:54.891842 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:54.892691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:54.893119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:54.893488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4c7ed282-e2d6-4706-a9fe-d7663646e54b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.177600 Nov 19 13:41:54.894082 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 470/927] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:54 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:54.918278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lazy-loading 'flavor' on Instance uuid b6bff66c-4dcd-4ade-9837-55946c611c03 {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:41:55.219058 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6356c545-2637-4bd1-bd3a-0e41471adf91 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 202 len: 0 microversion: 2.20 time: 0.339308 Nov 19 13:41:55.219806 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 458/928] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:41:54 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:41:55.229495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:55.230108 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:55.238502 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:55.238977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:55.240601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:55.241650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:55.390807 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:55.399365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:55.400984 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:55.402343 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c95757bf-34e3-4bdb-bdbe-cbe3ff651a11 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.177925 Nov 19 13:41:55.407241 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 471/929] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:55 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:55.890942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:55.891994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:55.899120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:55.899575 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:55.900360 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:55.900792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:55.911241 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:55.912164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:55.918463 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:55.918936 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:55.919756 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:55.920186 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:55.989776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ff76d540-e27e-4a92-9ad2-fba5e67c84e1 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28663 microversion: 2.1 time: 0.103258 Nov 19 13:41:55.990756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 459/930] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:55 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:56.072997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:56.081675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-493d82cf-3f93-4daf-8876-8b5dff064d54 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.174006 Nov 19 13:41:56.082162 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 472/931] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:55 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:56.422194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:56.422888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:56.430944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:56.431445 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:56.432240 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:56.432678 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:56.571833 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:56.580061 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:56.581682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:56.582858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-657244d6-304e-42cc-807d-8c1e02390c7e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.164979 Nov 19 13:41:56.583574 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 460/932] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:56 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:57.003348 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:57.004349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:57.011502 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:57.011961 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:57.012750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:57.013182 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:57.075608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b88da960-4f80-45a8-b095-834a00a4bb73 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28663 microversion: 2.1 time: 0.076796 Nov 19 13:41:57.076255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 473/933] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:56 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28663 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:57.099417 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:57.099997 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:57.106933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:57.107411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:57.108203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:57.108643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:57.261381 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:57.269464 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-174200c5-0ba8-4eb4-a7ff-aa73266e39db tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.174039 Nov 19 13:41:57.270044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 461/934] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:57 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:57.602785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:57.603502 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:57.610846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:57.611416 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:57.612201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:57.612595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:57.761148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:57.769806 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:57.771339 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:57.772615 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b4178a3f-f106-4f72-8fa7-47b8914cd534 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.174501 Nov 19 13:41:57.773207 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 474/935] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:57 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:58.088349 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:58.089326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:58.096236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:58.096686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:58.097479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:58.097908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:58.159729 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0ad5971a-81c5-4929-adcd-a207e8813cc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28663 microversion: 2.1 time: 0.075118 Nov 19 13:41:58.160425 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 462/936] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:58 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28663 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:58.287670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:58.288553 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:58.296168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:58.296615 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:58.297406 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:58.297833 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:58.450812 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:58.459569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5cc2f0cb-6170-49df-9e2b-fd6ab8ff21ef tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.175869 Nov 19 13:41:58.460181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 475/937] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:58 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:58.792804 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:58.793546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:58.800928 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:58.801385 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:58.802350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:58.802791 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:58.946122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:58.956154 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:58.957648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:58.959034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-47ff0beb-9a4c-4d01-b439-7262707a898e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.170541 Nov 19 13:41:58.959710 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 463/938] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:58 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:41:59.172208 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:41:59.173168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:59.180547 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:59.181013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:59.181789 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:59.182214 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:59.243897 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0325b846-2f0c-4154-a104-f8f4ff4ec07c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 28663 microversion: 2.1 time: 0.075199 Nov 19 13:41:59.244534 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 476/939] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:41:59 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 28663 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:41:59.477787 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:59.478386 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:59.485426 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:59.485879 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:59.486673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:59.487133 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:59.638648 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:41:59.646762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a54dbf98-5451-4579-9fde-b707793c45cf tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.173194 Nov 19 13:41:59.647587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 464/940] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:41:59 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:41:59.978916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:41:59.979652 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:41:59.988003 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:59.988514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:41:59.989425 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:41:59.989872 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:00.137873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:00.146827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:00.148340 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:00.149486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4d7a5a3c-52f5-48ea-81b0-72ba222fbe22 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.174912 Nov 19 13:42:00.150039 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 477/941] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:41:59 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:00.259278 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:00.260149 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:00.267134 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:00.267606 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:00.268405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:00.268843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:00.352873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1c1b0aaf-d44f-44e9-b406-db02edbbbc6b tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 29438 microversion: 2.1 time: 0.097616 Nov 19 13:42:00.354178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 465/942] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:00 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 29438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:00.664691 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:00.665440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:00.672466 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:00.672928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:00.673729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:00.674159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:00.821250 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:00.829461 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4a9d6a41-c3e3-4280-afc2-5fa0408d29f3 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.168763 Nov 19 13:42:00.830074 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 478/943] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:00 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:01.168860 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:01.169551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:01.177100 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:01.177564 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:01.178359 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:01.178795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:01.322202 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:01.330280 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:01.331810 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:01.333027 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fa1eafd7-7f06-4381-95f7-7d54dfa30034 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.168298 Nov 19 13:42:01.333820 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 466/944] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:01 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:01.365456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:01.366417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:01.373207 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:01.373654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:01.374431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:01.374858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:01.455331 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-35be76e0-44eb-4205-b788-debc1240338f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 31221 microversion: 2.1 time: 0.093480 Nov 19 13:42:01.455959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 479/945] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:01 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 31221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:01.847327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:01.847947 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:01.854560 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:01.855019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:01.855811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:01.856245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:02.005630 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:02.013671 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e1c83282-0f66-4cd1-aef0-3446330f56c1 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.170283 Nov 19 13:42:02.014513 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 467/946] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:01 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:02.354090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:02.354803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:02.363575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:02.364283 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:02.365675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:02.366224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:02.467863 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:02.468833 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:02.476310 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:02.476783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:02.477604 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:02.478062 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:02.520320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:02.530139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:02.531673 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:02.532862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9bb24a2f-9184-4667-a15c-c4c8572d7665 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.184631 Nov 19 13:42:02.533431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 480/947] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:02 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:02.559705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-96719b1d-8324-4269-a7c1-072894e193d0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 33078 microversion: 2.1 time: 0.095298 Nov 19 13:42:02.560373 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 468/948] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:02 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 33078 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:42:03.034911 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:03.035554 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:03.042353 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:03.042808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:03.043643 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:03.044079 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:03.220880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:03.230421 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-da764ffb-6258-49b9-92d7-21a0239277b4 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.199957 Nov 19 13:42:03.231115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 481/949] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:03 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:03.553177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:03.553880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:03.563760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:03.564385 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:03.565559 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:03.566307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:03.571963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:03.572944 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:03.579471 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:03.579949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:03.580730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:03.581155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:03.660500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b7bbf8c4-d7b3-43ef-ab34-66da186dc925 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 33838 microversion: 2.1 time: 0.091989 Nov 19 13:42:03.661084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 482/950] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:03 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 33838 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:03.711611 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:03.721072 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:03.722793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:03.724153 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c9e66920-1b14-4eb7-9f7a-68cf45c757ee tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.175357 Nov 19 13:42:03.724694 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 469/951] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:03 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:04.251379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:04.252061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:04.259684 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:04.260133 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:04.260905 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:04.261327 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:04.419548 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:04.428347 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4b405dda-4a10-42fb-b037-8342164c6a64 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1757 microversion: 2.1 time: 0.181071 Nov 19 13:42:04.429024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 483/952] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:04 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:04.677723 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:04.679170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:04.686577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:04.687053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:04.687928 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:04.688371 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:04.742945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:04.743581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:04.750188 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:04.750616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:04.751427 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:04.751856 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:04.760139 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b7495253-5e3a-46e1-abd5-56bfcabef018 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 34807 microversion: 2.1 time: 0.088420 Nov 19 13:42:04.761295 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 470/953] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:04 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 34807 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:04.891445 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:04.900361 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:04.902455 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:04.904015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-753736be-333a-4f3f-b60b-423c66c54eca tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.165341 Nov 19 13:42:04.904602 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 484/954] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:04 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:42:05.448239 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:05.448836 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:05.459080 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:05.459633 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:05.460621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:05.461055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:05.616987 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:05.631645 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-15b35e7e-359c-4400-8e4c-682ff3d307da tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1760 microversion: 2.1 time: 0.187248 Nov 19 13:42:05.632949 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 471/955] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:05 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:05.773564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:05.774418 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:05.781366 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:05.781824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:05.782625 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:05.783067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:05.863243 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-77ec0a94-6b47-4bd9-bffd-0b35e544383c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 35646 microversion: 2.1 time: 0.093674 Nov 19 13:42:05.864203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 485/956] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:05 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 35646 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 13:42:05.926001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:05.926605 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:05.934022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:05.934474 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:05.935302 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:05.935749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:06.087181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:06.095685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:06.097186 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:06.098361 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-faede79c-7136-421a-bb35-934d663283e0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1745 microversion: 2.20 time: 0.176279 Nov 19 13:42:06.098942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 472/957] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:05 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:06.876535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:06.877537 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:06.885001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:06.885446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:06.886226 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:06.886660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:06.963149 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-df3af63b-eca3-4880-922b-85021a9bce0a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 36825 microversion: 2.1 time: 0.090590 Nov 19 13:42:06.963936 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 486/958] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:06 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 36825 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:07.117460 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:07.118098 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:07.124940 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:07.125400 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:07.126189 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:07.126693 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:07.266510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:07.274734 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:07.276275 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:07.277442 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-635787de-dfa6-4533-aaf8-a99ac2ee8d53 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1745 microversion: 2.20 time: 0.163951 Nov 19 13:42:07.278039 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 473/959] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:07 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:07.977751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:07.978777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:07.985908 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:07.986482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:07.987285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:07.987719 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:08.059049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4d85a14c-6bf7-45af-98e2-8b78ec7f0e27 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 37742 microversion: 2.1 time: 0.085513 Nov 19 13:42:08.059708 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 487/960] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:07 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 37742 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:08.297069 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:08.298130 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:08.306585 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:08.307410 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:08.308805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:08.309554 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:08.464253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:08.475115 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:08.477298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:08.478700 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4b562a5b-76ec-4a21-8a77-78883443d8c7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.186460 Nov 19 13:42:08.479785 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 474/961] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:08 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:42:09.072040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:09.073860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:09.083776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:09.084530 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:09.085641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:09.086239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:09.187521 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4f2494bf-6129-4aa8-ab80-d4e4de56c995 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 38194 microversion: 2.1 time: 0.120099 Nov 19 13:42:09.197497 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 488/962] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:09 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 38194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:09.497888 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:09.499205 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:09.506327 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:09.507155 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:09.508446 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:09.509188 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:09.674628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:09.684289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:09.685817 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:09.687122 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-301c5c68-cf8a-43eb-8409-b412b83d2957 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.193223 Nov 19 13:42:09.687829 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 475/963] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:09 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:10.206018 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:10.207065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:10.215922 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:10.216374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:10.217226 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:10.217660 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:10.292560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-15af9eae-d9ed-4063-85f4-9aecfdd9dfa9 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 38194 microversion: 2.1 time: 0.090469 Nov 19 13:42:10.297034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 489/964] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:10 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 38194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:10.715902 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:10.717355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:10.725718 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:10.726616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:10.727675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:10.728224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:10.883001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:10.892145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:10.893757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:10.895462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ac0bb248-f3cc-4865-a3f1-e6c5302e094d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.184859 Nov 19 13:42:10.896120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 476/965] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:10 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:11.233172 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-2a5270fd-1acc-436d-a2a6-26b40ea9b2f6 req-0b1d0c56-8863-482f-8637-bcf565fa2f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "name": "network-vif-plugged", "status": "completed", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:11.235576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:11.235576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:42:11.245162 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2a5270fd-1acc-436d-a2a6-26b40ea9b2f6 req-0b1d0c56-8863-482f-8637-bcf565fa2f4c service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:11.246007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2a5270fd-1acc-436d-a2a6-26b40ea9b2f6 req-0b1d0c56-8863-482f-8637-bcf565fa2f4c service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:11.270302 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-2a5270fd-1acc-436d-a2a6-26b40ea9b2f6 req-0b1d0c56-8863-482f-8637-bcf565fa2f4c service nova] Creating event network-vif-plugged:96b4d778-35ca-4bef-a1ed-070e56519720 for instance b6bff66c-4dcd-4ade-9837-55946c611c03 on hv-cinder-81735 Nov 19 13:42:11.276185 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-2a5270fd-1acc-436d-a2a6-26b40ea9b2f6 req-0b1d0c56-8863-482f-8637-bcf565fa2f4c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137392 Nov 19 13:42:11.277111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 490/966] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:42:11.305357 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:11.306298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:11.312762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:11.313238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:11.314063 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:11.314740 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:11.379570 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b0cfa6a0-8b3e-48b1-986e-7f8bf74f7845 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 38194 microversion: 2.1 time: 0.077610 Nov 19 13:42:11.383883 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 477/967] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:11 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 38194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:11.919048 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:11.920875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:11.933330 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:11.934339 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:11.935785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:11.936961 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:12.120748 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:12.130375 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:12.132259 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:12.133544 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5994ed0f-b04b-4403-b04b-1310359813ef tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.222338 Nov 19 13:42:12.134115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 491/968] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:11 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:12.393050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:12.394121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:12.401748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:12.402207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:12.403054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:12.403510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:12.488954 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b82d0573-c5ef-4412-8fd3-20aa69617c03 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action" status: 200 len: 38323 microversion: 2.1 time: 0.100055 Nov 19 13:42:12.495050 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 478/969] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:12 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/action => generated 38323 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:12.500707 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:12.501285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:12.509139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:12.509588 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:12.510386 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:12.510815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:12.543399 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7cfa0145-bfc9-466d-a8ff-bdcce6951a7d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/ips" status: 200 len: 147 microversion: 2.1 time: 0.046350 Nov 19 13:42:12.544373 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 492/970] 10.222.0.74 () {58 vars in 1247 bytes} [Fri Nov 19 13:42:12 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:13.154520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:13.155344 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:13.165885 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:13.166730 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:13.167867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:13.168505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:13.348508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:13.361231 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:13.362814 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:13.364246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-901714e7-94a0-41d0-8c94-3ab43a4a4dac tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.216259 Nov 19 13:42:13.364825 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 479/971] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:13 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:13.946514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63009157-26a0-413a-9417-8bfec751f0e8"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:13.947995 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:13.954988 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:13.955581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:13.956459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:13.956958 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:14.279800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-34c302b1-e097-4c7d-bd8c-f3275fb44dc2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338250 Nov 19 13:42:14.280754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 493/972] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:42:13 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:14.388635 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:14.389878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:14.400522 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:14.400996 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:14.401804 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:14.402284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:14.592853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:14.602467 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:14.604341 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:14.605830 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-165b55f5-a861-4c56-a833-0c32bd5a43c5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.224891 Nov 19 13:42:14.606908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 480/973] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:14 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:15.630311 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:15.631050 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:15.638384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:15.638973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:15.639894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:15.640577 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:15.806104 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:15.815489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:15.817649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:15.818964 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7af121e5-d04b-4288-be29-0a1628522dc0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.193576 Nov 19 13:42:15.819927 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 494/974] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:15 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:16.843232 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:16.844078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:16.850717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:16.852993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:16.854166 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:16.854357 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:17.033858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:17.047988 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:17.049479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:17.050658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-21d6a628-dd6d-4507-884f-bda25e519738 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.215109 Nov 19 13:42:17.051870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 481/975] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:16 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:18.073536 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:18.074328 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:18.083883 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:18.084329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:18.085495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:18.085858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:18.233587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:18.242266 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:18.243933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:18.245170 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e01d2a4d-0fba-4c6c-8b90-19f4659478f1 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1740 microversion: 2.20 time: 0.175794 Nov 19 13:42:18.245751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 495/976] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:18 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:19.267489 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:19.268114 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:19.275515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:19.275968 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:19.276755 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:19.277190 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:19.418100 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:19.426715 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:19.428238 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:19.429611 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-49ac7c81-85d9-414e-8d37-c2c9f944f43c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1722 microversion: 2.20 time: 0.165966 Nov 19 13:42:19.430792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 482/977] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:19 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:20.450620 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:20.451250 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:20.458154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:20.458621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:20.459495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:20.459927 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:20.615135 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:20.624566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:20.626146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:20.627571 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-22ed410e-8a3c-4762-9184-edc1617c4464 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1722 microversion: 2.20 time: 0.181230 Nov 19 13:42:20.628159 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 496/978] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:20 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:21.649264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:21.650249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:21.658235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.658690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.659521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.659990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.808952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:21.817520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:21.819326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:21.820517 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f3d5e543-e814-429c-a24d-a2d94b233e00 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1665 microversion: 2.20 time: 0.177441 Nov 19 13:42:21.821126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 483/979] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:21 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:21.839641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6048db58-8907-4c91-b5ea-0856f8685dd9"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:21.841304 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:21.844397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:21.845362 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:21.848626 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.849331 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.850102 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.850646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.852103 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.852548 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.853402 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.853807 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.886160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-55bbcabc-19af-4013-bcaa-3821a671a45c tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045632 Nov 19 13:42:21.886752 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 484/980] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:42:21 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:21.896430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:21.897341 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:21.903548 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.904006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.904811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:21.905249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:21.939246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1254cbeb-3512-48ad-92c6-e1a3d825d6be tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/63009157-26a0-413a-9417-8bfec751f0e8" status: 200 len: 194 microversion: 2.1 time: 0.046240 Nov 19 13:42:21.940118 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 485/981] 10.222.0.74 () {58 vars in 1412 bytes} [Fri Nov 19 13:42:21 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/63009157-26a0-413a-9417-8bfec751f0e8 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:42:22.153084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b67ca93e-0b2e-4e62-80ba-392d9522551a tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316996 Nov 19 13:42:22.155347 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 497/982] 10.222.0.74 () {62 vars in 1363 bytes} [Fri Nov 19 13:42:21 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 13:42:22.282275 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:22.282791 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:22.289057 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:22.289538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:22.290329 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:22.290761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:22.563973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4b5629be-f708-42d4-8ec3-c853263be8a4 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-volume_attachments/6048db58-8907-4c91-b5ea-0856f8685dd9" status: 202 len: 0 microversion: 2.20 time: 0.285545 Nov 19 13:42:22.564606 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 486/983] 10.222.0.74 () {60 vars in 1456 bytes} [Fri Nov 19 13:42:22 2021] DELETE /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-volume_attachments/6048db58-8907-4c91-b5ea-0856f8685dd9 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:42:22.624287 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:22.625295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:22.635858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:22.636606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:22.637538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:22.637968 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:22.794223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-24af16a6-9e41-4987-96ac-0e91d26f018d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action" status: 202 len: 0 microversion: 2.20 time: 0.175030 Nov 19 13:42:22.794845 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 498/984] 10.222.0.74 () {62 vars in 1318 bytes} [Fri Nov 19 13:42:22 2021] POST /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:42:22.803676 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:22.804291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:22.812016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:22.812527 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:22.813306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:22.813788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:22.982382 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:22.993198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:22.995056 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:22.996697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-a3d8b71f-3b0d-4c15-ad17-6d09887a1c1f tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1673 microversion: 2.20 time: 0.196871 Nov 19 13:42:22.997232 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 487/985] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:22 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:23.081578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-badeff13-e791-4626-a1d2-eeaa97f6213b req-c3832549-1a21-40ee-8af1-2c1ca84c513a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "name": "network-vif-unplugged", "status": "completed", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:23.083983 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:23.083983 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:42:23.091777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-badeff13-e791-4626-a1d2-eeaa97f6213b req-c3832549-1a21-40ee-8af1-2c1ca84c513a service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:23.092667 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-badeff13-e791-4626-a1d2-eeaa97f6213b req-c3832549-1a21-40ee-8af1-2c1ca84c513a service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:23.106895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.compute.server_external_events [req-badeff13-e791-4626-a1d2-eeaa97f6213b req-c3832549-1a21-40ee-8af1-2c1ca84c513a service nova] Unable to find a host for instance b6bff66c-4dcd-4ade-9837-55946c611c03. Dropping event network-vif-unplugged {{(pid=122814) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 19 13:42:23.107851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-badeff13-e791-4626-a1d2-eeaa97f6213b req-c3832549-1a21-40ee-8af1-2c1ca84c513a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030132 Nov 19 13:42:23.108782 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 499/986] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:23 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 19 13:42:23.294809 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9d05cec-9065-430a-8b06-a701bb4f3463"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:23.295969 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:23.301846 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:23.302304 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:23.303106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:23.303556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:23.591942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-227d49b1-e6e4-4017-90a3-a7d190d6349a tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300689 Nov 19 13:42:23.592588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 488/987] 10.222.0.74 () {60 vars in 1322 bytes} [Fri Nov 19 13:42:23 2021] POST /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:24.016064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:24.016672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:24.022815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:24.023310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:24.024124 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:24.024563 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:24.241999 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:24.250164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:24.251886 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:24.253162 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-961d218b-e714-4167-a961-a7b1a5d21d20 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.241137 Nov 19 13:42:24.253923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 500/988] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:24 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:25.274022 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:25.274719 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:25.282113 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:25.282850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:25.283835 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:25.284419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:25.437703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:25.446748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:25.448203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:25.449440 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bcc7d83d-4a11-4821-8115-8651e411c3bd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.180897 Nov 19 13:42:25.450217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 489/989] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:25 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:26.469574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:26.470187 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:26.483153 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:26.483609 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:26.484404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:26.484834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:26.639613 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:26.648078 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:26.649564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:26.650721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-95bf86ee-319d-427a-8033-8efe4d1bd9a9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.186818 Nov 19 13:42:26.651335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 501/990] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:26 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 13:42:27.670090 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:27.671571 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:27.678306 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:27.678758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:27.679973 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:27.680386 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:27.826937 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:27.835330 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:27.836836 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:27.838055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-446077ba-242f-4689-852f-1eeac70b61b9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.172123 Nov 19 13:42:27.838673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 490/991] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:27 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:28.858117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:28.858903 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:28.865957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:28.866160 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:28.866874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:28.867363 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:29.019987 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:29.029346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:29.033282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:29.033282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7bd4d749-c7c1-4331-9bb4-cf42e8d919d7 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.178460 Nov 19 13:42:29.033282 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 502/992] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:28 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:30.057811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:30.061012 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:30.067076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:30.067944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:30.069000 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:30.069561 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:30.223911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:30.232958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:30.234449 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:30.235660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1ec1e74c-62fb-481b-94df-02f24ca9d20e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.188214 Nov 19 13:42:30.236468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 491/993] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:30 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:31.260120 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:31.260761 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:31.268204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:31.269053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:31.270108 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:31.270949 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:31.428705 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:31.441559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:31.443069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:31.446105 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ac0c659a-52f2-404e-8660-f72d38da6591 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.190310 Nov 19 13:42:31.446707 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 503/994] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:31 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:32.466269 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:32.466920 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:32.474191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:32.474633 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:32.476393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:32.476831 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:32.619650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:32.628992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:32.630738 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:32.632095 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bcaeb62e-0c09-4af9-8980-556d1014b883 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.170222 Nov 19 13:42:32.643679 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 492/995] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:32 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:33.650990 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:33.651670 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:33.658837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:33.659612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:33.660422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:33.660879 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:33.809535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:33.819201 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:33.820694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:33.821860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-02cf8a6b-5eef-4860-8cce-5b49f483c2a5 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.174722 Nov 19 13:42:33.822434 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 504/996] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:33 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:34.843348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:34.844075 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:34.850704 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:34.851190 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:34.851977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:34.852411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:35.004146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:35.013103 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:35.014651 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:35.015934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c8bc7d2d-04b1-4b8c-b80e-7169497c761e tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.178077 Nov 19 13:42:35.016509 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 493/997] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:34 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:36.034946 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:36.035766 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:36.044059 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:36.044526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:36.045322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:36.045752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:36.188395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:36.200213 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:36.201704 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:36.203019 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a5565acf-47d2-48bd-8724-e11b9a822f43 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.172499 Nov 19 13:42:36.203729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 505/998] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:36 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:37.221992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:37.222577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:37.229837 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:37.230324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:37.231142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:37.231571 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:37.367396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:37.375867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:37.377284 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:37.378518 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-668cb6dd-0701-456d-95ea-f7b9b5f819db tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.160655 Nov 19 13:42:37.379130 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 494/999] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:37 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:38.397717 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:38.398299 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:38.404849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.405294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.406081 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.406526 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.495806 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:38.496881 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:38.504260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.504800 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.505673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.506170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.536951 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-768c7d68-a702-4488-b961-2b75d6ec54aa tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044919 Nov 19 13:42:38.537626 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 495/1000] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:42:38 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:38.542085 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:38.550777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:38.552294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:38.553494 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9afdeab0-ddef-440e-a5b7-2ee6f24e98ed tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.159576 Nov 19 13:42:38.554085 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 506/1001] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:38 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:38.795632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:38.796457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:38.812243 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.813000 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.814318 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.814774 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.845960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-282f667a-5efe-4ec1-927e-5980677c9356 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/63009157-26a0-413a-9417-8bfec751f0e8" status: 200 len: 194 microversion: 2.1 time: 0.056661 Nov 19 13:42:38.846670 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 496/1002] 10.222.0.74 () {58 vars in 1412 bytes} [Fri Nov 19 13:42:38 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/63009157-26a0-413a-9417-8bfec751f0e8 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:38.856837 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:38.857338 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:38.864108 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.864646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.865559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:38.866154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:38.953849 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lazy-loading 'services' on Instance uuid 940a641e-0c00-4c96-b29f-92bd6a3514ad {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:42:39.040126 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f11ca4bb-2e17-4068-9b51-a142f92db3f2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/63009157-26a0-413a-9417-8bfec751f0e8" status: 202 len: 0 microversion: 2.1 time: 0.187214 Nov 19 13:42:39.040763 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 507/1003] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:42:38 2021] DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/63009157-26a0-413a-9417-8bfec751f0e8 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:42:39.206074 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1179538722"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:39.206691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:39.213601 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:39.214084 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:39.214910 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:39.215395 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:39.362176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.network.security_group_api [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Removing security group 15636211-33b7-4acd-8d2d-bacf82528983 from port 2ae72a4b-e531-4747-b7bd-e16df6dee43f Nov 19 13:42:39.575163 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:39.575906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:39.582619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:39.583065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:39.583918 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:39.584352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:39.806944 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dfcd0068-cee0-4203-bc33-ca86b1444f62 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.605545 Nov 19 13:42:39.810812 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 497/1004] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:42:39 2021] POST /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:42:39.826169 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-3303e152-a999-4654-a8ec-265c11eb540b req-21662271-8bc2-406e-8b4d-08e1bbb93c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:39.827903 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:39.829071 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:39.829071 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:42:39.838672 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-3303e152-a999-4654-a8ec-265c11eb540b req-21662271-8bc2-406e-8b4d-08e1bbb93c71 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:39.839565 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-3303e152-a999-4654-a8ec-265c11eb540b req-21662271-8bc2-406e-8b4d-08e1bbb93c71 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:39.840650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:39.842153 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:39.844179 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-495aef54-a9e5-41d9-bb92-5e8448ffae37 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.273810 Nov 19 13:42:39.844769 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 508/1005] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:39 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:39.874836 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-3303e152-a999-4654-a8ec-265c11eb540b req-21662271-8bc2-406e-8b4d-08e1bbb93c71 service nova] Creating event network-changed:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:42:39.882176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-3303e152-a999-4654-a8ec-265c11eb540b req-21662271-8bc2-406e-8b4d-08e1bbb93c71 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066772 Nov 19 13:42:39.883470 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 498/1006] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:40.177614 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:40.178440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:40.189516 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:40.189984 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:40.191959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:40.192520 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:40.400467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-5e1e0fbd-4796-4260-a5b1-b388afb4da15 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/c9d05cec-9065-430a-8b06-a701bb4f3463" status: 200 len: 194 microversion: 2.1 time: 0.226969 Nov 19 13:42:40.401523 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 509/1007] 10.222.0.74 () {58 vars in 1412 bytes} [Fri Nov 19 13:42:40 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/c9d05cec-9065-430a-8b06-a701bb4f3463 => generated 194 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:40.412391 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:40.412961 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:40.420120 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:40.420527 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:40.421524 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:40.421956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:40.504644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lazy-loading 'services' on Instance uuid 940a641e-0c00-4c96-b29f-92bd6a3514ad {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:42:40.588254 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-28a03549-aa76-4a55-b483-0eca8dba9b3e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/c9d05cec-9065-430a-8b06-a701bb4f3463" status: 202 len: 0 microversion: 2.1 time: 0.180470 Nov 19 13:42:40.589494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 499/1008] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:42:40 2021] DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments/c9d05cec-9065-430a-8b06-a701bb4f3463 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:42:40.863603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:40.864230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:40.871058 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:40.871518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:40.872328 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:40.872751 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.014212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:41.022685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:41.024180 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:41.025346 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d5ca073e-43f4-47b5-9e2a-c50b8ac3196c tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.165671 Nov 19 13:42:41.025906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 510/1009] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:40 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:41.092709 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:41.093298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:41.093956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-d00ba3e3-611b-498f-81a7-d340303fa9ae req-23d8e8b7-be2a-48c2-8db3-1d6c3cf0a8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:41.095825 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:41.095825 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:42:41.103041 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.103247 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d00ba3e3-611b-498f-81a7-d340303fa9ae req-23d8e8b7-be2a-48c2-8db3-1d6c3cf0a8aa service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.103570 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-d00ba3e3-611b-498f-81a7-d340303fa9ae req-23d8e8b7-be2a-48c2-8db3-1d6c3cf0a8aa service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.104495 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.107525 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.107979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.114923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-d00ba3e3-611b-498f-81a7-d340303fa9ae req-23d8e8b7-be2a-48c2-8db3-1d6c3cf0a8aa service nova] Creating event network-changed:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:42:41.121074 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-d00ba3e3-611b-498f-81a7-d340303fa9ae req-23d8e8b7-be2a-48c2-8db3-1d6c3cf0a8aa service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Nov 19 13:42:41.122157 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 511/1010] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:41.219748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lazy-loading 'services' on Instance uuid caec44c8-3924-450a-83bc-961394694ffa {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:42:41.312240 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cbc89b85-976b-48c0-bed4-531822faee9f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "DELETE /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments/db0cc681-9101-48bf-90d8-974729ccf8ed" status: 202 len: 0 microversion: 2.1 time: 0.222589 Nov 19 13:42:41.313146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 500/1011] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:42:41 2021] DELETE /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments/db0cc681-9101-48bf-90d8-974729ccf8ed => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:42:41.322875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:41.324357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:41.332056 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.332986 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.334539 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.335681 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.379604 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cc4d6a08-d281-49cb-bbce-5a5673d96316 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061241 Nov 19 13:42:41.380368 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 512/1012] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:42:41 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:41.756687 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:41.757758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:41.764588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.765226 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.766034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.766471 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.797244 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f5f6ef89-1c8f-4c92-9bf0-81a5d132a48f tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046155 Nov 19 13:42:41.797811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 501/1013] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:42:41 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:42:41.907963 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:41.909080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:41.915644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.916102 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.916888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:41.917314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:41.946785 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a6907a97-7319-499e-8d8d-5ca2379da7b2 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042669 Nov 19 13:42:41.947404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 513/1014] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:42:41 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:42:42.009195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:42.010112 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:42.017408 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.018087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.019160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.019598 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.047610 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:42:42.051726 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:42.052665 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:42.061407 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.062250 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.063387 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.064995 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.154243 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cc3b0e25-785e-449e-b8b1-48006a116b45 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 204 len: 0 microversion: 2.1 time: 0.149329 Nov 19 13:42:42.155940 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 502/1015] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:42:42 2021] DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:42:42.165868 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:42.166556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:42.173291 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.173749 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.174657 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.175130 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.235299 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:42.243946 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:42.245424 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:42.246581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-65871055-2fa0-4dcc-aa6a-94f3f82cf4cd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.198789 Nov 19 13:42:42.254676 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 514/1016] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:42 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:42.331048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:42.339145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-10fda820-7aae-420a-9207-6479f5afefc3 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1674 microversion: 2.1 time: 0.178021 Nov 19 13:42:42.344178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 503/1017] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:42 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:42:42.391478 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:42.392486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:42.399025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.399519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.400369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.400775 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.432084 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c819c65c-4679-48a9-9e33-dbcf4e579a36 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044425 Nov 19 13:42:42.432676 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 515/1018] 10.222.0.74 () {58 vars in 1301 bytes} [Fri Nov 19 13:42:42 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 13:42:42.443496 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:42.444036 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:42.450144 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.450594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.451401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:42.451840 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:42.529182 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] HTTP exception thrown: Instance caec44c8-3924-450a-83bc-961394694ffa is not attached to volume db0cc681-9101-48bf-90d8-974729ccf8ed Nov 19 13:42:42.530053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Returning 404 to user: Instance caec44c8-3924-450a-83bc-961394694ffa is not attached to volume db0cc681-9101-48bf-90d8-974729ccf8ed {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:42.530905 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e8cc5aad-74a6-4119-8f2f-925a2313a7e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "DELETE /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments/db0cc681-9101-48bf-90d8-974729ccf8ed" status: 404 len: 154 microversion: 2.1 time: 0.091935 Nov 19 13:42:42.531711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 504/1019] 10.222.0.74 () {58 vars in 1415 bytes} [Fri Nov 19 13:42:42 2021] DELETE /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa/os-volume_attachments/db0cc681-9101-48bf-90d8-974729ccf8ed => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:42:43.265575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:43.266203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:43.273234 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.273676 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.274419 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.274880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.294457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-85e6856e-8451-404f-ad52-51bf1192f9c3 req-52b62b8a-180c-45c0-9f49-927d2ce8f1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "name": "network-vif-plugged", "status": "completed", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:43.296815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:43.296815 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:42:43.305716 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-85e6856e-8451-404f-ad52-51bf1192f9c3 req-52b62b8a-180c-45c0-9f49-927d2ce8f1a2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.305980 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-85e6856e-8451-404f-ad52-51bf1192f9c3 req-52b62b8a-180c-45c0-9f49-927d2ce8f1a2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.318158 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-85e6856e-8451-404f-ad52-51bf1192f9c3 req-52b62b8a-180c-45c0-9f49-927d2ce8f1a2 service nova] Creating event network-vif-plugged:96b4d778-35ca-4bef-a1ed-070e56519720 for instance b6bff66c-4dcd-4ade-9837-55946c611c03 on hv-cinder-81735 Nov 19 13:42:43.323437 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-85e6856e-8451-404f-ad52-51bf1192f9c3 req-52b62b8a-180c-45c0-9f49-927d2ce8f1a2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Nov 19 13:42:43.324390 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 505/1020] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:43.361059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:43.362105 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:43.369144 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.369516 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.370307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.370776 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.431374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:43.439842 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:43.441390 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:43.442957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-84e8e6bc-1453-495c-bec0-da71b30f37a0 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.181263 Nov 19 13:42:43.443722 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 516/1021] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:43 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:43.545799 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:43.553877 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-684e035e-5d10-419a-aeb8-d53acd76d250 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1674 microversion: 2.1 time: 0.199440 Nov 19 13:42:43.554787 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 506/1022] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:43 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:43.687533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:43.688183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:43.696971 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.697425 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.698255 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.698682 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.724441 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:42:43.802613 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6480e1fa-3411-4081-a1f6-e59b35601e1b tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "DELETE /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 204 len: 0 microversion: 2.1 time: 0.120178 Nov 19 13:42:43.803212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 517/1023] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:42:43 2021] DELETE /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:42:43.811778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:43.812448 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:43.818727 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.819217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.820009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:43.820451 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:43.959479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:43.971652 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-992c95c6-692a-4000-889e-ea2f5481be13 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1554 microversion: 2.1 time: 0.163684 Nov 19 13:42:43.972213 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 507/1024] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:43 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:44.462509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:44.463310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:44.470443 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:44.471087 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:44.471928 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:44.472374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:44.574108 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:44.574667 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:44.581467 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:44.582142 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:44.582757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:44.583194 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:44.745916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:44.760495 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:44.762052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:44.763292 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a20e55c7-e2a7-4e88-a462-a8e888058d58 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1731 microversion: 2.20 time: 0.305124 Nov 19 13:42:44.771685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 518/1025] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:44 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:44.856010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c357c1b48a4305bce5451ee68de6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a84768546e2479ab48c55cca9d00d88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:44.869444 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4fccb500-6bb3-4b01-a146-c12f3919209e tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 200 len: 1674 microversion: 2.1 time: 0.299132 Nov 19 13:42:44.870069 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 508/1026] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:44 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 1674 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:44.994001 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:44.994658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:45.001096 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.001711 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.002811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.003482 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.252332 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-d47a0e41-e39e-4597-8846-7b512ca28b3d req-acb60205-6979-4c77-a0d2-acedb1a3a23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940a641e-0c00-4c96-b29f-92bd6a3514ad", "name": "network-vif-deleted", "tag": "b2bd181d-30d4-41e4-a9e9-27005b9e68f3"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:45.254644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:45.254644 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:42:45.265047 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-d47a0e41-e39e-4597-8846-7b512ca28b3d req-acb60205-6979-4c77-a0d2-acedb1a3a23d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.265777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-d47a0e41-e39e-4597-8846-7b512ca28b3d req-acb60205-6979-4c77-a0d2-acedb1a3a23d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.285924 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-d47a0e41-e39e-4597-8846-7b512ca28b3d req-acb60205-6979-4c77-a0d2-acedb1a3a23d service nova] Creating event network-vif-deleted:b2bd181d-30d4-41e4-a9e9-27005b9e68f3 for instance 940a641e-0c00-4c96-b29f-92bd6a3514ad on hv-cinder-81735 Nov 19 13:42:45.288432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:45.291537 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-d47a0e41-e39e-4597-8846-7b512ca28b3d req-acb60205-6979-4c77-a0d2-acedb1a3a23d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044525 Nov 19 13:42:45.293140 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 509/1027] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:42:45.296576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d4f30456-1500-45a1-952f-828c23844bff tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1554 microversion: 2.1 time: 0.306362 Nov 19 13:42:45.299851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 519/1028] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:44 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1554 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:45.787381 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:45.788919 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:45.799349 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.802503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.803803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.807412 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.889417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:45.890173 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:45.898075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.898798 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.899907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:45.900466 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:45.916552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] HTTP exception thrown: Instance 940a641e-0c00-4c96-b29f-92bd6a3514ad could not be found. Nov 19 13:42:45.917409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Returning 404 to user: Instance 940a641e-0c00-4c96-b29f-92bd6a3514ad could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:45.918480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7e7007bc-d450-4ca4-bb9d-e4b15849ad8d tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 404 len: 111 microversion: 2.1 time: 0.033828 Nov 19 13:42:45.920111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 520/1029] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:45 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 13:42:45.928703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c7a002fa-c3b4-4625-9c9c-8b54fea77785 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '.version_select at 0x7fb429b9b040>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:45.947824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c7a002fa-c3b4-4625-9c9c-8b54fea77785 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216809709" status: 202 len: 0 microversion: 2.1 time: 0.022999 Nov 19 13:42:45.953122 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 521/1030] 10.222.0.74 () {58 vars in 1220 bytes} [Fri Nov 19 13:42:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216809709 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 13:42:46.035681 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:46.045959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:46.047964 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:46.049614 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7f766ca0-eae5-4a3f-9909-97a8c299c75b tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1718 microversion: 2.20 time: 0.267400 Nov 19 13:42:46.064401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 510/1031] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:42:45 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1718 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:42:46.316519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:46.316956 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:46.323238 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:46.323734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:46.324524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:46.325032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:46.456408 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee601659ab344b3db3fdc7226dc6f33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85281dbfabf143df85af115a347baa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:42:46.466014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0a835b39-6541-4f1d-b442-0e1acbc778e5 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 200 len: 1512 microversion: 2.1 time: 0.154064 Nov 19 13:42:46.466608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 522/1032] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:46 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:42:47.320550 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-52ea4aa8-9838-4264-aaf9-2961b1ff7fe2 req-3248b86c-8435-48b5-a1e2-abdf603bb65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caec44c8-3924-450a-83bc-961394694ffa", "name": "network-vif-deleted", "tag": "2ae72a4b-e531-4747-b7bd-e16df6dee43f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:42:47.323006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:42:47.323006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:42:47.334270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-52ea4aa8-9838-4264-aaf9-2961b1ff7fe2 req-3248b86c-8435-48b5-a1e2-abdf603bb65d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:47.334717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-52ea4aa8-9838-4264-aaf9-2961b1ff7fe2 req-3248b86c-8435-48b5-a1e2-abdf603bb65d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:47.346270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-52ea4aa8-9838-4264-aaf9-2961b1ff7fe2 req-3248b86c-8435-48b5-a1e2-abdf603bb65d service nova] Creating event network-vif-deleted:2ae72a4b-e531-4747-b7bd-e16df6dee43f for instance caec44c8-3924-450a-83bc-961394694ffa on hv-cinder-81735 Nov 19 13:42:47.351199 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-52ea4aa8-9838-4264-aaf9-2961b1ff7fe2 req-3248b86c-8435-48b5-a1e2-abdf603bb65d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037079 Nov 19 13:42:47.351781 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 511/1033] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:42:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:42:47.484310 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:47.484923 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] [instance: caec44c8-3924-450a-83bc-961394694ffa] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:47.492095 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:47.492542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:47.493314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:47.493747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:47.507593 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] HTTP exception thrown: Instance caec44c8-3924-450a-83bc-961394694ffa could not be found. Nov 19 13:42:47.508207 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Returning 404 to user: Instance caec44c8-3924-450a-83bc-961394694ffa could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:47.509056 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-82d2b166-f2d8-4091-9401-00e3a1c6db78 tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa" status: 404 len: 111 microversion: 2.1 time: 0.028661 Nov 19 13:42:47.509611 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 523/1034] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:47 2021] GET /compute/v2.1/servers/caec44c8-3924-450a-83bc-961394694ffa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:42:47.522106 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-66ce8e8f-2dce-4c6b-9d3b-e8cf7a40936f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] Calling method '.version_select at 0x7fb429d10160>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:47.552975 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-66ce8e8f-2dce-4c6b-9d3b-e8cf7a40936f tempest-TestMinimumBasicScenario-833343224 tempest-TestMinimumBasicScenario-833343224-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2035220342" status: 202 len: 0 microversion: 2.1 time: 0.036456 Nov 19 13:42:47.553544 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 512/1035] 10.222.0.74 () {58 vars in 1271 bytes} [Fri Nov 19 13:42:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2035220342 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:42:49.067680 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:49.068216 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:49.074378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:49.074832 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:49.075679 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:49.076119 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:49.089739 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] HTTP exception thrown: Instance 940a641e-0c00-4c96-b29f-92bd6a3514ad could not be found. Nov 19 13:42:49.090333 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Returning 404 to user: Instance 940a641e-0c00-4c96-b29f-92bd6a3514ad could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:49.091363 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e9d0dad9-4621-4342-8107-272f7393edcc tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 404 len: 111 microversion: 2.1 time: 0.027836 Nov 19 13:42:49.091910 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 524/1036] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:42:49 2021] DELETE /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:42:49.100850 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:49.101646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 940a641e-0c00-4c96-b29f-92bd6a3514ad] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:49.108135 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:49.108600 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:49.109401 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:49.109836 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:49.125461 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] HTTP exception thrown: Instance 940a641e-0c00-4c96-b29f-92bd6a3514ad could not be found. Nov 19 13:42:49.126096 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Returning 404 to user: Instance 940a641e-0c00-4c96-b29f-92bd6a3514ad could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:49.126933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1da39b4a-d6d2-4972-9711-e7476b9bf513 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad" status: 404 len: 111 microversion: 2.1 time: 0.030764 Nov 19 13:42:49.128499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 513/1037] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:49 2021] GET /compute/v2.1/servers/940a641e-0c00-4c96-b29f-92bd6a3514ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:42:50.263674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:50.264393 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:50.271488 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:50.271920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:50.272706 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:50.273459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:50.287360 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] HTTP exception thrown: Instance 74979cdc-e64b-40da-8cf1-7f6311e51aec could not be found. Nov 19 13:42:50.288046 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Returning 404 to user: Instance 74979cdc-e64b-40da-8cf1-7f6311e51aec could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:50.288930 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-16b6e088-5a74-43b6-b3c4-f51d05c32073 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "DELETE /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 404 len: 111 microversion: 2.1 time: 0.029119 Nov 19 13:42:50.289470 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 525/1038] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:42:50 2021] DELETE /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:42:50.297721 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:42:50.298512 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] [instance: 74979cdc-e64b-40da-8cf1-7f6311e51aec] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:42:50.305758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:50.306537 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:50.308273 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:42:50.308820 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:42:50.323195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] HTTP exception thrown: Instance 74979cdc-e64b-40da-8cf1-7f6311e51aec could not be found. Nov 19 13:42:50.323967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] Returning 404 to user: Instance 74979cdc-e64b-40da-8cf1-7f6311e51aec could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:42:50.324933 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-10ada27b-f1db-48e4-84c7-d1ac0864cad0 tempest-AttachVolumeTestJSON-162414113 tempest-AttachVolumeTestJSON-162414113-project] 10.222.0.74 "GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec" status: 404 len: 111 microversion: 2.1 time: 0.031100 Nov 19 13:42:50.325611 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 514/1039] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:42:50 2021] GET /compute/v2.1/servers/74979cdc-e64b-40da-8cf1-7f6311e51aec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:08.737032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-314d2b2b-5c14-4b15-9c40-683f77d64602 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Action: 'create', calling method: .version_select at 0x7fb429b9be50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-589091822"}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:08.753665 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-314d2b2b-5c14-4b15-9c40-683f77d64602 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:43:08.758547 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-314d2b2b-5c14-4b15-9c40-683f77d64602 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for user da4e222a82204884973d0f20621d1c3c and project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:43:09.085980 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-314d2b2b-5c14-4b15-9c40-683f77d64602 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:43:09.090262 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-314d2b2b-5c14-4b15-9c40-683f77d64602 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for user da4e222a82204884973d0f20621d1c3c and project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'key_pairs'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:43:09.104316 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-314d2b2b-5c14-4b15-9c40-683f77d64602 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.553718 Nov 19 13:43:09.104951 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 526/1040] 10.222.0.74 () {60 vars in 1157 bytes} [Fri Nov 19 13:43:08 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:15.146591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:15.147593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:15.154417 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:15.154907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:15.155764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:15.156204 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:15.192684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-66fd1eb3-2966-4ea2-8b10-50aa149c3abd tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050511 Nov 19 13:43:15.193281 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 515/1041] 10.222.0.74 () {60 vars in 1342 bytes} [Fri Nov 19 13:43:15 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:15.264167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:15.264717 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:15.270980 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:15.271458 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:15.272229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:15.272658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:15.298891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:43:15.387669 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d9df3bc8-30b0-432a-a716-849f33298e8d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 204 len: 0 microversion: 2.20 time: 0.127107 Nov 19 13:43:15.388543 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 527/1042] 10.222.0.74 () {60 vars in 1279 bytes} [Fri Nov 19 13:43:15 2021] DELETE /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 13:43:15.396877 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:15.397515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:15.403697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:15.404143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:15.404937 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:15.405373 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:15.557728 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:15.569224 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:15.570722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:15.571963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fe335162-92ce-4c71-ae99-0353cb015c51 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.179030 Nov 19 13:43:15.572624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 516/1043] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:43:15 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:43:16.593569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:16.594268 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:16.601146 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:16.601608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:16.602729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:16.603516 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:16.756156 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:16.764552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:16.766045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:16.767322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d0f51045-b8d7-4c73-87d6-2b9dbcddd568 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1724 microversion: 2.20 time: 0.177929 Nov 19 13:43:16.767975 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 528/1044] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:43:16 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:43:17.789250 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:17.789986 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:17.797642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:17.798094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:17.798887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:17.799364 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:17.897348 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:17.907172 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:17.909093 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e712519a9d54cee964e57814985b4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be95e890da954a74b914b3e0aef316c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:17.910617 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1f1e88c0-7244-48fd-92a8-87865d603d1d tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 200 len: 1656 microversion: 2.20 time: 0.127371 Nov 19 13:43:17.911219 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 517/1045] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:43:17 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 1656 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 13:43:18.163861 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-b0460ef3-5f84-4d04-81c8-a0b35fe8dc31 req-6c7cf864-c4b0-40b6-884d-99aa3b8fb451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bff66c-4dcd-4ade-9837-55946c611c03", "name": "network-vif-deleted", "tag": "96b4d778-35ca-4bef-a1ed-070e56519720"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:18.166828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:18.166828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:43:18.180117 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-b0460ef3-5f84-4d04-81c8-a0b35fe8dc31 req-6c7cf864-c4b0-40b6-884d-99aa3b8fb451 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:18.180637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-b0460ef3-5f84-4d04-81c8-a0b35fe8dc31 req-6c7cf864-c4b0-40b6-884d-99aa3b8fb451 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:18.194700 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-b0460ef3-5f84-4d04-81c8-a0b35fe8dc31 req-6c7cf864-c4b0-40b6-884d-99aa3b8fb451 service nova] Creating event network-vif-deleted:96b4d778-35ca-4bef-a1ed-070e56519720 for instance b6bff66c-4dcd-4ade-9837-55946c611c03 on hv-cinder-81735 Nov 19 13:43:18.205476 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-b0460ef3-5f84-4d04-81c8-a0b35fe8dc31 req-6c7cf864-c4b0-40b6-884d-99aa3b8fb451 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041906 Nov 19 13:43:18.207138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 529/1046] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:43:18.930967 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:18.931599 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:18.938501 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:18.938949 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:18.939792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:18.940225 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:18.960116 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] HTTP exception thrown: Instance b6bff66c-4dcd-4ade-9837-55946c611c03 could not be found. Nov 19 13:43:18.960755 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Returning 404 to user: Instance b6bff66c-4dcd-4ade-9837-55946c611c03 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:18.961848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-6451febb-ab15-4864-8cde-e656c09c5fde tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 404 len: 111 microversion: 2.20 time: 0.035743 Nov 19 13:43:18.962828 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 518/1047] 10.222.0.74 () {60 vars in 1276 bytes} [Fri Nov 19 13:43:18 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 13:43:18.972395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ceaf3d58-91a1-4c34-8179-f7df104fd372 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '.version_select at 0x7fb42a555040>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:18.994011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ceaf3d58-91a1-4c34-8179-f7df104fd372 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103492664" status: 204 len: 0 microversion: 2.20 time: 0.025730 Nov 19 13:43:18.994612 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 530/1048] 10.222.0.74 () {60 vars in 1261 bytes} [Fri Nov 19 13:43:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103492664 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 13:43:20.826307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:20.826813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:20.833354 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:20.833805 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:20.834586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:20.835019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:20.852580 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] HTTP exception thrown: Instance b6bff66c-4dcd-4ade-9837-55946c611c03 could not be found. Nov 19 13:43:20.853191 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Returning 404 to user: Instance b6bff66c-4dcd-4ade-9837-55946c611c03 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:20.854053 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dabd12cd-076c-44c6-b635-dbec9a8d3a12 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 404 len: 111 microversion: 2.1 time: 0.031531 Nov 19 13:43:20.854637 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 519/1049] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:43:20 2021] DELETE /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:20.865242 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:20.865940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: b6bff66c-4dcd-4ade-9837-55946c611c03] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:20.872491 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:20.872940 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:20.873735 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:20.874167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:20.888081 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] HTTP exception thrown: Instance b6bff66c-4dcd-4ade-9837-55946c611c03 could not be found. Nov 19 13:43:20.888675 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Returning 404 to user: Instance b6bff66c-4dcd-4ade-9837-55946c611c03 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:20.889532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8012a2e5-0d7c-4796-abd6-de7719066b09 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03" status: 404 len: 111 microversion: 2.1 time: 0.028585 Nov 19 13:43:20.890066 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 531/1050] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:20 2021] GET /compute/v2.1/servers/b6bff66c-4dcd-4ade-9837-55946c611c03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:22.033579 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:22.034203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:22.041616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:22.042074 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:22.042909 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:22.043503 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:22.058997 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] HTTP exception thrown: Instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 could not be found. Nov 19 13:43:22.059686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Returning 404 to user: Instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:22.060532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5bbbb308-9605-441d-b570-3a7c104aeef6 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 404 len: 111 microversion: 2.1 time: 0.032149 Nov 19 13:43:22.061092 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 520/1051] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:43:22 2021] DELETE /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:22.069367 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:22.070324 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] [instance: 6d127235-a875-411b-939b-ee6f9b1ae4c1] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:22.077428 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:22.078002 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:22.078966 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:22.079426 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:22.094148 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] HTTP exception thrown: Instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 could not be found. Nov 19 13:43:22.094759 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] Returning 404 to user: Instance 6d127235-a875-411b-939b-ee6f9b1ae4c1 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:22.095658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-927316c1-1c80-4bcf-bb88-57e186a72ba9 tempest-AttachVolumeShelveTestJSON-2136024076 tempest-AttachVolumeShelveTestJSON-2136024076-project] 10.222.0.74 "GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1" status: 404 len: 111 microversion: 2.1 time: 0.030210 Nov 19 13:43:22.096216 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 532/1052] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:22 2021] GET /compute/v2.1/servers/6d127235-a875-411b-939b-ee6f9b1ae4c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:25.301737 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-592176677", "imageRef": "8df409ea-508a-4d8b-902c-d073cdcbb90d", "flavorRef": "452"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:25.371653 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] validate_networks() for None {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:43:25.722483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:43:25.722984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:43:25.723460 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:43:25.723873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:43:25.724296 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:43:25.734125 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:25.734578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:25.735441 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:25.735895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:25.752324 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Getting quotas for project 66b0b65b622744afa401e5470efe9460. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:43:25.756393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Getting quotas for user 5be0aec5637543d9aa918b8fc40c4cbd and project 66b0b65b622744afa401e5470efe9460. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:43:25.768482 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:43:25.771204 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8df409ea-508a-4d8b-902c-d073cdcbb90d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:43:25.819505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-825285c1-df1a-46ca-84ca-e83ea4a87481 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521483 Nov 19 13:43:25.820374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 521/1053] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:43:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 13:43:25.830822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b1cd9732-0a07-4dca-bbcb-6e300bcf59e8 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:25.832045 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b1cd9732-0a07-4dca-bbcb-6e300bcf59e8 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:25.894477 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b1cd9732-0a07-4dca-bbcb-6e300bcf59e8 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:25.902731 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b1cd9732-0a07-4dca-bbcb-6e300bcf59e8 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1214 microversion: 2.1 time: 0.075643 Nov 19 13:43:25.903337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 533/1054] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:25 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:26.921006 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:26.922499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:26.932531 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:26.933237 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:26.934411 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:26.934995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:27.046004 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:27.054577 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e56e2b3a-b06b-4cb0-a1ff-5c86ec0adf81 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1272 microversion: 2.1 time: 0.138195 Nov 19 13:43:27.055553 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 522/1055] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:26 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:27.116709 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-148f0113-4c4b-455b-9c96-6e719f45df8b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Action: 'create', calling method: .version_select at 0x7fb429b5b430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-439313727", "metadata": {"Type": "work"}}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:27.119007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-148f0113-4c4b-455b-9c96-6e719f45df8b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:27.119007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-148f0113-4c4b-455b-9c96-6e719f45df8b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135875 Nov 19 13:43:27.123335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 534/1056] 10.222.0.74 () {60 vars in 1155 bytes} [Fri Nov 19 13:43:26 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 19 13:43:27.129287 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2c18bd69-d811-47d8-bf8a-8645817119f7 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Action: 'create', calling method: .version_select at 0x7fb429cdaee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-748658454", "metadata": {"Type": "work"}}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:27.130930 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2c18bd69-d811-47d8-bf8a-8645817119f7 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:27.131853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2c18bd69-d811-47d8-bf8a-8645817119f7 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006482 Nov 19 13:43:27.137885 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 523/1057] 10.222.0.74 () {60 vars in 1155 bytes} [Fri Nov 19 13:43:27 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 13:43:27.143899 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c8c83ccd-8bea-461c-9868-880c52426f0a tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Action: 'create', calling method: .version_select at 0x7fb429b5b940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1417199089", "metadata": {"Type": "work"}}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:27.145040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c8c83ccd-8bea-461c-9868-880c52426f0a tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:27.145822 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c8c83ccd-8bea-461c-9868-880c52426f0a tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006697 Nov 19 13:43:27.146490 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 535/1058] 10.222.0.74 () {60 vars in 1155 bytes} [Fri Nov 19 13:43:27 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 13:43:27.155849 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-08a5637b-3a7f-4205-95f8-5505b7542942 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Calling method '.version_select at 0x7fb429c7cd30>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:27.187406 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-08a5637b-3a7f-4205-95f8-5505b7542942 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] HTTP exception thrown: Volume tempest-invalid-38137317 could not be found. Nov 19 13:43:27.188026 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-08a5637b-3a7f-4205-95f8-5505b7542942 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Returning 404 to user: Volume tempest-invalid-38137317 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:27.188867 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-08a5637b-3a7f-4205-95f8-5505b7542942 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/tempest-invalid-38137317" status: 404 len: 97 microversion: 2.1 time: 0.036852 Nov 19 13:43:27.189405 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 524/1059] 10.222.0.74 () {58 vars in 1211 bytes} [Fri Nov 19 13:43:27 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-38137317 => generated 97 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 19 13:43:27.199352 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-221992fa-0436-4e1d-9f9d-14d0415605c0 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004080 Nov 19 13:43:27.201134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 536/1060] 10.222.0.74 () {58 vars in 1139 bytes} [Fri Nov 19 13:43:27 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 13:43:27.218037 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f9e9c5de-f08e-448b-9e9f-258f196a5f83 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003632 Nov 19 13:43:27.218703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 525/1061] 10.222.0.74 () {58 vars in 1136 bytes} [Fri Nov 19 13:43:27 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 13:43:27.228524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-329b985e-8450-4306-9f8d-8491961c591b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Calling method '.version_select at 0x7fb429ae58b0>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:27.257899 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-329b985e-8450-4306-9f8d-8491961c591b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] HTTP exception thrown: Volume d00eb019-c0e2-4327-9e98-bbc4c8ec0649 could not be found. Nov 19 13:43:27.258532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-329b985e-8450-4306-9f8d-8491961c591b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Returning 404 to user: Volume d00eb019-c0e2-4327-9e98-bbc4c8ec0649 could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:27.259433 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-329b985e-8450-4306-9f8d-8491961c591b tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/d00eb019-c0e2-4327-9e98-bbc4c8ec0649" status: 404 len: 109 microversion: 2.1 time: 0.034782 Nov 19 13:43:27.260009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 537/1062] 10.222.0.74 () {58 vars in 1247 bytes} [Fri Nov 19 13:43:27 2021] DELETE /compute/v2.1/os-volumes/d00eb019-c0e2-4327-9e98-bbc4c8ec0649 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 13:43:27.271245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7f51e872-6550-40a1-b844-7532b2390d47 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Calling method '.version_select at 0x7fb429c7c1f0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:27.299853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-7f51e872-6550-40a1-b844-7532b2390d47 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] HTTP exception thrown: Volume 9539f802-71e9-48dc-a3da-e94ce154fbd8 could not be found. Nov 19 13:43:27.300481 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7f51e872-6550-40a1-b844-7532b2390d47 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] Returning 404 to user: Volume 9539f802-71e9-48dc-a3da-e94ce154fbd8 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:27.301345 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7f51e872-6550-40a1-b844-7532b2390d47 tempest-VolumesNegativeTest-1464553949 tempest-VolumesNegativeTest-1464553949-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/9539f802-71e9-48dc-a3da-e94ce154fbd8" status: 404 len: 109 microversion: 2.1 time: 0.035226 Nov 19 13:43:27.301881 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 526/1063] 10.222.0.74 () {58 vars in 1244 bytes} [Fri Nov 19 13:43:27 2021] GET /compute/v2.1/os-volumes/9539f802-71e9-48dc-a3da-e94ce154fbd8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:27.769253 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1450239698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-589091822", "security_groups": [{"name": "tempest-secgroup-smoke-1976351387"}], "block_device_mapping_v2": [{"uuid": "f0f52223-f2db-45bc-bd64-4c807048a6fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e99b515c-40f9-48bf-80e5-bf33416424d2"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:27.973357 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] validate_networks() for [('e99b515c-40f9-48bf-80e5-bf33416424d2', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:43:28.073338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:28.074088 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:28.081538 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:28.082126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:28.083595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:28.084761 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:28.385661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:28.393838 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e64937fc-3cc7-49da-94e8-424433c08ea3 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.324946 Nov 19 13:43:28.394952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 527/1064] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:28 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:43:28.736534 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:43:28.737030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:43:28.737485 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:43:28.737888 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:43:28.738294 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:43:28.748184 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:28.748658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:28.749644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:28.750075 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:28.768708 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:43:28.772965 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for user da4e222a82204884973d0f20621d1c3c and project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:43:28.823068 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-c0bd5536-d3f3-403e-be8e-8623380dae9b req-7353cd08-9696-4000-b399-334576663fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608d6b89-1cca-4b89-8de4-fe49d65b1130", "tag": "3f292975-29a0-4c12-9dc3-b0bb7df8899f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:28.824777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:28.824777 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:43:28.835943 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-c0bd5536-d3f3-403e-be8e-8623380dae9b req-7353cd08-9696-4000-b399-334576663fb1 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:28.836391 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-c0bd5536-d3f3-403e-be8e-8623380dae9b req-7353cd08-9696-4000-b399-334576663fb1 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:28.860980 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:43:28.864220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0f52223-f2db-45bc-bd64-4c807048a6fd',volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:43:28.891979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-c0bd5536-d3f3-403e-be8e-8623380dae9b req-7353cd08-9696-4000-b399-334576663fb1 service nova] Creating event network-changed:3f292975-29a0-4c12-9dc3-b0bb7df8899f for instance 608d6b89-1cca-4b89-8de4-fe49d65b1130 on hv-cinder-81735 Nov 19 13:43:28.900176 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-c0bd5536-d3f3-403e-be8e-8623380dae9b req-7353cd08-9696-4000-b399-334576663fb1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081417 Nov 19 13:43:28.901146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 528/1065] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:43:29.046883 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6d6ca9ff-fe04-4c43-91bc-db92b40a56f3 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.283545 Nov 19 13:43:29.047858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 538/1066] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:43:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:43:29.061307 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ce4cbb91-4885-4a6d-818f-a2656f938e99 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:29.062214 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ce4cbb91-4885-4a6d-818f-a2656f938e99 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:29.145842 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ce4cbb91-4885-4a6d-818f-a2656f938e99 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:29.156092 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ce4cbb91-4885-4a6d-818f-a2656f938e99 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1094 microversion: 2.1 time: 0.101331 Nov 19 13:43:29.156672 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 529/1067] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:29 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1094 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:29.414584 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:29.415698 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:29.425240 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:29.425690 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:29.426563 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:29.427026 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:29.657614 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:29.679245 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-eb93fc8b-033b-4164-ac6e-f73c9a7f85bd tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.271246 Nov 19 13:43:29.679967 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 539/1068] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:29 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:30.175595 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:30.176998 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:30.184679 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:30.185419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:30.186368 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:30.187126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:30.561132 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:30.572048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2e285df2-e43b-4a59-85c6-e54859bd3fb6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1210 microversion: 2.1 time: 0.401792 Nov 19 13:43:30.573071 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 530/1069] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:30 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1210 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:30.698036 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:30.698672 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:30.705945 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:30.706637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:30.707471 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:30.707914 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:30.938461 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:30.946766 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-45fef39a-9231-4673-b38a-a32f517158d2 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.253952 Nov 19 13:43:30.948272 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 540/1070] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:30 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:31.589313 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:31.589959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:31.597418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:31.597870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:31.598712 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:31.600177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:31.810162 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:31.820160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-9f4c6555-09a1-431a-8603-5a2ee6cfcd04 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.234026 Nov 19 13:43:31.820787 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 531/1071] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:31 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:31.963702 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:31.964815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:31.972233 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:31.972762 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:31.973650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:31.974171 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:32.190624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-0eaee50f-2888-4929-899b-9ea4c70a68c5 req-94d167c3-99a4-41ff-8888-2cf41edef69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef224f6-580f-4fd7-8f80-8e580dc79b2c", "tag": "9a9d1cdc-1baa-46a7-bc17-23842379e031"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:32.201844 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:32.201844 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:43:32.223794 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:32.227143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-0eaee50f-2888-4929-899b-9ea4c70a68c5 req-94d167c3-99a4-41ff-8888-2cf41edef69f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:32.227686 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-0eaee50f-2888-4929-899b-9ea4c70a68c5 req-94d167c3-99a4-41ff-8888-2cf41edef69f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:32.238983 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2de7c93e-a48b-42cc-8f48-af1d1bbeb49b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.279403 Nov 19 13:43:32.239606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 541/1072] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:31 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:32.245963 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-0eaee50f-2888-4929-899b-9ea4c70a68c5 req-94d167c3-99a4-41ff-8888-2cf41edef69f service nova] Creating event network-changed:9a9d1cdc-1baa-46a7-bc17-23842379e031 for instance fef224f6-580f-4fd7-8f80-8e580dc79b2c on hv-cinder-81735 Nov 19 13:43:32.251393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-0eaee50f-2888-4929-899b-9ea4c70a68c5 req-94d167c3-99a4-41ff-8888-2cf41edef69f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072984 Nov 19 13:43:32.252255 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 532/1073] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:43:32.837624 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:32.838412 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:32.844179 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:32.844917 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:32.845946 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:32.846349 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:33.061381 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:33.069129 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-ffa126da-767e-412c-ae18-d6d2bc8405df tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.235151 Nov 19 13:43:33.069915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 542/1074] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:32 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:33.258253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:33.259069 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:33.265416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:33.266153 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:33.267141 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:33.267769 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:33.478588 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:33.487673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f88a17b7-5e7d-49d1-aca5-2bbf1e107d63 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.235232 Nov 19 13:43:33.488222 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 533/1075] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:33 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:34.085754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:34.086374 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:34.092977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:34.093391 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:34.094219 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:34.094630 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:34.239661 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:34.247480 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-23d175b6-e16a-4b44-b244-0f720b4da516 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.165504 Nov 19 13:43:34.248020 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 543/1076] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:34 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:34.505771 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:34.506399 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:34.513458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:34.513910 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:34.514690 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:34.515131 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:34.655418 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:34.663074 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-46ba2ac4-10e0-497c-a614-da9417cec19a tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.161110 Nov 19 13:43:34.663759 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 534/1077] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:34 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:35.263469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:35.264165 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:35.270808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:35.271518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:35.272518 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:35.273011 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:35.420799 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:35.428637 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9dbaa5ac-09a6-4057-8b7d-7fc1bffc76f6 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.168956 Nov 19 13:43:35.429417 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 544/1078] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:35 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:35.499885 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-e590129f-f131-46e8-b628-e7aef1027bd3 req-64f91841-eb70-4d0f-a3a7-6fadad2453c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608d6b89-1cca-4b89-8de4-fe49d65b1130", "name": "network-vif-plugged", "status": "completed", "tag": "3f292975-29a0-4c12-9dc3-b0bb7df8899f"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:35.501628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:35.501628 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:43:35.510361 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-e590129f-f131-46e8-b628-e7aef1027bd3 req-64f91841-eb70-4d0f-a3a7-6fadad2453c3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:35.510958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-e590129f-f131-46e8-b628-e7aef1027bd3 req-64f91841-eb70-4d0f-a3a7-6fadad2453c3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:35.528709 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-e590129f-f131-46e8-b628-e7aef1027bd3 req-64f91841-eb70-4d0f-a3a7-6fadad2453c3 service nova] Creating event network-vif-plugged:3f292975-29a0-4c12-9dc3-b0bb7df8899f for instance 608d6b89-1cca-4b89-8de4-fe49d65b1130 on hv-cinder-81735 Nov 19 13:43:35.533691 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-e590129f-f131-46e8-b628-e7aef1027bd3 req-64f91841-eb70-4d0f-a3a7-6fadad2453c3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037790 Nov 19 13:43:35.534555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 535/1079] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:43:35.681633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:35.682458 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:35.688527 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:35.689038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:35.690297 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:35.690805 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:35.866566 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:35.875054 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b6d27b4c-32ba-45df-a854-706143ec2340 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1314 microversion: 2.1 time: 0.198254 Nov 19 13:43:35.875673 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 545/1080] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:35 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:36.449455 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:36.450151 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:36.459949 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:36.460506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:36.461270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:36.461729 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:36.597253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:36.605488 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e4aac680-3051-495f-ad2e-3ac02ce3464c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.162695 Nov 19 13:43:36.606088 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 536/1081] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:36 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:36.892538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:36.893139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:36.901537 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:36.902634 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:36.904032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:36.904646 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.050600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:37.059017 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-55695e2e-e092-4b4d-8689-cc04df603998 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1463 microversion: 2.1 time: 0.170292 Nov 19 13:43:37.066197 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 546/1082] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:36 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:37.098659 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:37.099236 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:37.106170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:37.106779 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.108813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:37.109439 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.138374 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Going to try to terminate instance {{(pid=122815) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:43:37.227811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bffc3e92-77dc-491a-b447-9878fa61e0f9 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "DELETE /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 204 len: 0 microversion: 2.1 time: 0.132581 Nov 19 13:43:37.228474 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 537/1083] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:43:37 2021] DELETE /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:43:37.237090 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:37.237586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:37.243850 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:37.244297 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.245077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:37.245509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.392973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:37.403628 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c304a344-c9ad-4bcf-8282-1406133ace03 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1469 microversion: 2.1 time: 0.170497 Nov 19 13:43:37.404493 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 547/1084] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:37 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:37.625838 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:37.626443 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:37.636220 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:37.636808 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.637846 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:37.638436 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:37.794397 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:37.801965 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-49fdd749-87c3-49c7-9b0f-cf1cca0ca4ae tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.182746 Nov 19 13:43:37.802540 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 538/1085] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:37 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:38.423920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:38.424598 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:38.431778 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:38.432226 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:38.433024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:38.433459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:38.573714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:38.582135 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a5a1f107-9386-4519-ae6b-b95343899f46 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1469 microversion: 2.1 time: 0.161776 Nov 19 13:43:38.582772 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 548/1086] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:38 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:38.819234 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:38.819913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:38.826701 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:38.827286 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:38.828154 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:38.828685 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:39.044300 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:39.052404 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-09a0afc4-75dc-4aa9-989c-1ae2fbab0634 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.236744 Nov 19 13:43:39.053362 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 539/1087] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:38 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:39.145916 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-b9644885-3783-4d67-a076-7e1d66846465 req-bb5b6a80-0369-40bd-a3ad-531105ee567f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608d6b89-1cca-4b89-8de4-fe49d65b1130", "name": "network-vif-deleted", "tag": "3f292975-29a0-4c12-9dc3-b0bb7df8899f"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:39.148801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:39.148801 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:43:39.156649 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-b9644885-3783-4d67-a076-7e1d66846465 req-bb5b6a80-0369-40bd-a3ad-531105ee567f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:39.157308 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-b9644885-3783-4d67-a076-7e1d66846465 req-bb5b6a80-0369-40bd-a3ad-531105ee567f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:39.170055 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-b9644885-3783-4d67-a076-7e1d66846465 req-bb5b6a80-0369-40bd-a3ad-531105ee567f service nova] Creating event network-vif-deleted:3f292975-29a0-4c12-9dc3-b0bb7df8899f for instance 608d6b89-1cca-4b89-8de4-fe49d65b1130 on hv-cinder-81735 Nov 19 13:43:39.175644 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-b9644885-3783-4d67-a076-7e1d66846465 req-bb5b6a80-0369-40bd-a3ad-531105ee567f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033930 Nov 19 13:43:39.176456 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 549/1088] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:43:39.603496 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:39.604161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:39.611009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:39.611521 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:39.612370 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:39.612887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:39.682011 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:39.689798 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7926b17d-dfe3-4f5d-b3b4-8569a833fe08 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1427 microversion: 2.1 time: 0.092041 Nov 19 13:43:39.690387 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 540/1089] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:39 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:40.072252 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:40.072948 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:40.079959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:40.080409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:40.081199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:40.081630 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:40.239729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:40.252420 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-966d7d79-2750-4a6d-8cd9-610d67a2ba3b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.184844 Nov 19 13:43:40.253009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 550/1090] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:40 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:40.708462 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:40.709087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:40.717427 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:40.717993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:40.719161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:40.719789 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:40.786403 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:40.798394 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1d516926-048c-4ecc-9500-55600b99647f tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1299 microversion: 2.1 time: 0.094788 Nov 19 13:43:40.799215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 541/1091] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:40 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:41.274367 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:41.274973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:41.284889 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:41.285542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:41.286752 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:41.287441 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:41.436506 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:41.445295 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-27bc77e6-8917-44f0-aa00-a236ac57fbfc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.176754 Nov 19 13:43:41.445894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 551/1092] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:41 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:41.815959 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:41.816557 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:41.823775 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:41.824227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:41.825001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:41.825428 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:41.858067 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:41.858423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:41.858860 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lazy-loading 'fault' on Instance uuid 608d6b89-1cca-4b89-8de4-fe49d65b1130 {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:43:41.910662 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be0aec5637543d9aa918b8fc40c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b0b65b622744afa401e5470efe9460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:41.919427 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bb994478-c343-4acd-a308-40e2466f3a6b tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 200 len: 1304 microversion: 2.1 time: 0.107148 Nov 19 13:43:41.920031 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 542/1093] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:41 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:42.465558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:42.466228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:42.472862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:42.473355 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:42.474181 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:42.474650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:42.631921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:42.639542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1e94cb04-84cf-474a-9bec-2718040c1065 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.178604 Nov 19 13:43:42.640103 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 552/1094] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:42 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:42.937359 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:42.937910 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] [instance: 608d6b89-1cca-4b89-8de4-fe49d65b1130] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:42.944743 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:42.945221 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:42.946018 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:42.946449 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:42.960767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] HTTP exception thrown: Instance 608d6b89-1cca-4b89-8de4-fe49d65b1130 could not be found. Nov 19 13:43:42.961338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] Returning 404 to user: Instance 608d6b89-1cca-4b89-8de4-fe49d65b1130 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:43:42.962181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-3e502272-fedc-4ebd-87cf-f211014e4621 tempest-VolumesNegativeTest-2092559336 tempest-VolumesNegativeTest-2092559336-project] 10.222.0.74 "GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130" status: 404 len: 111 microversion: 2.1 time: 0.028828 Nov 19 13:43:42.962718 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 543/1095] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:42 2021] GET /compute/v2.1/servers/608d6b89-1cca-4b89-8de4-fe49d65b1130 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:43:43.660746 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:43.661358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:43.671920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:43.672616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:43.673596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:43.674324 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:43.841376 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:43.850565 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3719b8fb-d96f-445d-8977-6d4035eb6551 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.197428 Nov 19 13:43:43.851397 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 553/1096] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:43 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:44.867893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:44.868506 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:44.876035 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:44.876485 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:44.877283 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:44.877907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:45.037626 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:45.050487 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-20647f8d-cd41-4347-8aca-a4f5f6dcc874 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.186136 Nov 19 13:43:45.051119 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 544/1097] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:44 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:45.809738 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-6ed08d02-f923-4f2f-82ea-883761a8b31e req-6ebb64c4-d3e9-48d8-b990-cd3426031f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef224f6-580f-4fd7-8f80-8e580dc79b2c", "name": "network-vif-plugged", "status": "completed", "tag": "9a9d1cdc-1baa-46a7-bc17-23842379e031"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:45.811750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:45.811750 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:43:45.820640 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6ed08d02-f923-4f2f-82ea-883761a8b31e req-6ebb64c4-d3e9-48d8-b990-cd3426031f4f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:45.821089 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-6ed08d02-f923-4f2f-82ea-883761a8b31e req-6ebb64c4-d3e9-48d8-b990-cd3426031f4f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:45.834583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-6ed08d02-f923-4f2f-82ea-883761a8b31e req-6ebb64c4-d3e9-48d8-b990-cd3426031f4f service nova] Creating event network-vif-plugged:9a9d1cdc-1baa-46a7-bc17-23842379e031 for instance fef224f6-580f-4fd7-8f80-8e580dc79b2c on hv-cinder-81735 Nov 19 13:43:45.840967 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-6ed08d02-f923-4f2f-82ea-883761a8b31e req-6ebb64c4-d3e9-48d8-b990-cd3426031f4f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035855 Nov 19 13:43:45.841886 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 554/1098] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:43:46.069956 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:46.070564 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:46.078180 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:46.078660 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:46.079697 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:46.080146 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:46.252312 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:46.260510 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-84755fd1-442b-4fe9-b79f-52176051b003 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1266 microversion: 2.1 time: 0.194950 Nov 19 13:43:46.261104 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 545/1099] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:46 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:47.281694 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:47.282534 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:47.288884 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:47.289337 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:47.290111 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:47.290621 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:47.468461 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:47.477164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c51b4ca0-5e01-4c86-999f-b218e32c4ab4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1454 microversion: 2.1 time: 0.199970 Nov 19 13:43:47.477730 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 555/1100] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:47 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:47.494346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:43:47.495627 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:43:47.502064 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:47.502523 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:47.503335 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:47.503762 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:47.654873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:43:47.663858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8610db50-6afc-48cd-ba9b-f3ce193fcdaf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1454 microversion: 2.1 time: 0.173308 Nov 19 13:43:47.664728 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 546/1101] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:43:47 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:43:49.939543 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-2b1fea76-c7d5-4654-b541-6f77f3e863ab req-19d7c820-e49f-447c-af40-d0be4bc0ed1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef224f6-580f-4fd7-8f80-8e580dc79b2c", "tag": "9a9d1cdc-1baa-46a7-bc17-23842379e031"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:43:49.941698 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:43:49.941698 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:43:49.949300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2b1fea76-c7d5-4654-b541-6f77f3e863ab req-19d7c820-e49f-447c-af40-d0be4bc0ed1f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:43:49.949747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2b1fea76-c7d5-4654-b541-6f77f3e863ab req-19d7c820-e49f-447c-af40-d0be4bc0ed1f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:43:49.960974 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-2b1fea76-c7d5-4654-b541-6f77f3e863ab req-19d7c820-e49f-447c-af40-d0be4bc0ed1f service nova] Creating event network-changed:9a9d1cdc-1baa-46a7-bc17-23842379e031 for instance fef224f6-580f-4fd7-8f80-8e580dc79b2c on hv-cinder-81735 Nov 19 13:43:49.966394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-2b1fea76-c7d5-4654-b541-6f77f3e863ab req-19d7c820-e49f-447c-af40-d0be4bc0ed1f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030588 Nov 19 13:43:49.967052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 556/1102] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:43:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:44:45.648100 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ece9a7d1-6396-485e-a210-cc12c33eb01b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Action: 'create', calling method: .version_select at 0x7fb429bd1550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1564020743"}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:44:45.663921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-ece9a7d1-6396-485e-a210-cc12c33eb01b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Getting quotas for project 71727a03ae9846e9a726ad93e6670d8b. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:44:45.668264 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-ece9a7d1-6396-485e-a210-cc12c33eb01b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Getting quotas for user e5b2c44ee4d444f89b74d5a477e1fd2b and project 71727a03ae9846e9a726ad93e6670d8b. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:44:46.125267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-ece9a7d1-6396-485e-a210-cc12c33eb01b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Getting quotas for project 71727a03ae9846e9a726ad93e6670d8b. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:44:46.129277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-ece9a7d1-6396-485e-a210-cc12c33eb01b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Getting quotas for user e5b2c44ee4d444f89b74d5a477e1fd2b and project 71727a03ae9846e9a726ad93e6670d8b. Resources: {'key_pairs'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:44:46.151136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ece9a7d1-6396-485e-a210-cc12c33eb01b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.675379 Nov 19 13:44:46.152360 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 547/1103] 10.222.0.74 () {60 vars in 1157 bytes} [Fri Nov 19 13:44:45 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:02.398580 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2004198983", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1564020743", "security_groups": [{"name": "tempest-secgroup-smoke-429919052"}], "networks": [{"uuid": "4209ee4e-cad6-4cd8-82a7-cb2d4eece1a4"}], "block_device_mapping_v2": [{"uuid": "07430276-2ddc-4b72-8858-0d9676f5e9c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:02.510906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] validate_networks() for [('4209ee4e-cad6-4cd8-82a7-cb2d4eece1a4', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:45:02.914865 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:45:02.915559 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:45:02.916292 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:45:02.916914 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:45:02.917568 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:45:02.927405 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:02.927851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:02.928687 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:02.929125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:02.945824 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Getting quotas for project 71727a03ae9846e9a726ad93e6670d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:45:02.950223 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Getting quotas for user e5b2c44ee4d444f89b74d5a477e1fd2b and project 71727a03ae9846e9a726ad93e6670d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:45:03.007537 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:45:03.009933 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07430276-2ddc-4b72-8858-0d9676f5e9c7',volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:45:03.161158 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-217fff45-7399-4d86-8a01-e463ff36ce1f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767959 Nov 19 13:45:03.161907 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 557/1104] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:45:02 2021] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:45:03.173253 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-78d0bff0-b76c-4a68-8bfc-065fb2515f5a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:03.173946 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-78d0bff0-b76c-4a68-8bfc-065fb2515f5a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:03.228908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-78d0bff0-b76c-4a68-8bfc-065fb2515f5a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:03.237105 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-78d0bff0-b76c-4a68-8bfc-065fb2515f5a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1089 microversion: 2.1 time: 0.068361 Nov 19 13:45:03.237677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 548/1105] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:03 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:04.253586 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:04.254320 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:04.261753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:04.262335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:04.263168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:04.263593 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:04.365931 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:04.373658 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8226b2f0-6fe4-43a2-825f-aecef85ecf74 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1205 microversion: 2.1 time: 0.123752 Nov 19 13:45:04.374269 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 558/1106] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:04 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1205 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:05.391423 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:05.391991 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:05.398997 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:05.399675 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:05.400650 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:05.401247 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:05.662453 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-2c1cf699-34e7-40d9-9439-3ca789e75ed6 req-3fb49faf-e020-4b5e-9b99-b1d78f927437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:05.664431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:45:05.664431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:45:05.674069 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2c1cf699-34e7-40d9-9439-3ca789e75ed6 req-3fb49faf-e020-4b5e-9b99-b1d78f927437 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:05.674967 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-2c1cf699-34e7-40d9-9439-3ca789e75ed6 req-3fb49faf-e020-4b5e-9b99-b1d78f927437 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:05.688417 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:05.697466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-493e9abe-89d7-4888-8597-4de5f15506de tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.310207 Nov 19 13:45:05.702478 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-2c1cf699-34e7-40d9-9439-3ca789e75ed6 req-3fb49faf-e020-4b5e-9b99-b1d78f927437 service nova] Creating event network-changed:1eba2ad4-a45b-4aba-acd3-de14483ba311 for instance f60f66c3-3910-4b50-93c8-254aa931e10c on hv-cinder-81735 Nov 19 13:45:05.708372 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 549/1107] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:05 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:05.709810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-2c1cf699-34e7-40d9-9439-3ca789e75ed6 req-3fb49faf-e020-4b5e-9b99-b1d78f927437 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050913 Nov 19 13:45:05.710848 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 559/1108] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:45:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:45:06.716556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:06.717141 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:06.724319 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:06.724795 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:06.725799 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:06.726240 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:07.033964 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:07.041682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-14ae6c6b-6c6c-41a5-a768-0c279550e239 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.329639 Nov 19 13:45:07.042260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 550/1109] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:06 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:08.060595 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:08.061552 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:08.072891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:08.073533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:08.075800 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:08.076251 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:08.237012 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:08.249977 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e6c8f0a5-91fc-4cc4-bd5e-1f8522006844 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.194001 Nov 19 13:45:08.250606 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 560/1110] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:08 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:09.271637 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:09.272596 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:09.281941 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:09.282684 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:09.283207 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:09.283764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:09.420621 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:09.428766 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-cee01715-32a2-4b7f-9e6f-b48883ec7472 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.163509 Nov 19 13:45:09.429356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 551/1111] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:09 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:10.449967 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:10.451065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:10.458315 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:10.458760 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:10.459603 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:10.460031 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:10.613016 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:10.620874 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-92253b1f-d756-4493-8b0e-f4c885cf561e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.177328 Nov 19 13:45:10.621448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 561/1112] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:10 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:11.641274 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:11.641906 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:11.650972 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:11.651658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:11.652873 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:11.653603 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:11.811803 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:11.819792 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-95fbc9ed-6367-4348-9723-e6f8981abfe2 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.183945 Nov 19 13:45:11.820365 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 552/1113] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:11 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:12.837230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:12.837915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:12.844789 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:12.845220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:12.846030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:12.846459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:12.986096 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:12.996014 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8a8cdb52-9bbb-43ea-86f0-d47b2908002b tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.162585 Nov 19 13:45:12.996583 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 562/1114] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:12 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:14.015655 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:14.016499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:14.024049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:14.024491 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:14.025274 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:14.025711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:14.173330 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:14.181647 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-7fd070bf-96b4-4b8e-a7c7-dba7ec5a96f0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.170722 Nov 19 13:45:14.182247 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 553/1115] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:14 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:15.200156 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:15.200890 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:15.209252 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:15.209777 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:15.211322 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:15.211876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:15.358238 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:15.367491 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-2e8df227-4345-4416-9ba6-4bbfebf7cc38 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.172123 Nov 19 13:45:15.368104 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 563/1116] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:15 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:16.168091 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-a612e374-bb00-49bc-8108-7d528029e995 req-95f0f536-d2ea-4905-b93c-ed39fbd2ac92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "name": "network-vif-plugged", "status": "completed", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:16.169874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:45:16.169874 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:45:16.179029 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-a612e374-bb00-49bc-8108-7d528029e995 req-95f0f536-d2ea-4905-b93c-ed39fbd2ac92 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:16.179553 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-a612e374-bb00-49bc-8108-7d528029e995 req-95f0f536-d2ea-4905-b93c-ed39fbd2ac92 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:16.194653 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-a612e374-bb00-49bc-8108-7d528029e995 req-95f0f536-d2ea-4905-b93c-ed39fbd2ac92 service nova] Creating event network-vif-plugged:1eba2ad4-a45b-4aba-acd3-de14483ba311 for instance f60f66c3-3910-4b50-93c8-254aa931e10c on hv-cinder-81735 Nov 19 13:45:16.201231 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-a612e374-bb00-49bc-8108-7d528029e995 req-95f0f536-d2ea-4905-b93c-ed39fbd2ac92 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036673 Nov 19 13:45:16.202049 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 554/1117] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:45:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:45:16.386832 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:16.387576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:16.396685 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:16.397137 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:16.397920 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:16.398347 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:16.583817 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:16.593432 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-f9732ff2-759e-4d73-9169-d50508569331 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1260 microversion: 2.1 time: 0.212090 Nov 19 13:45:16.594077 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 564/1118] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:16 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:17.612859 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:17.613551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:17.620950 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:17.621404 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:17.622196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:17.622632 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:17.929427 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:17.941325 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ee6ad74e-7a00-4426-a985-524c176c7146 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1445 microversion: 2.1 time: 0.334249 Nov 19 13:45:17.941925 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 555/1119] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:17 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1445 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:17.957533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:17.958138 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:17.964254 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:17.964718 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:17.965517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:17.966043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:18.116998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:18.129292 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fe2d018a-d41b-4b60-b1da-d4f95441f777 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1445 microversion: 2.1 time: 0.175394 Nov 19 13:45:18.129882 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 565/1120] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:17 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:19.968530 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-85c6dc54-f8f3-433d-8499-596ccf953e95 req-f0fa2372-66c6-475d-93a2-c13d9d5cfc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:19.970019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:45:19.970019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:45:19.977738 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-85c6dc54-f8f3-433d-8499-596ccf953e95 req-f0fa2372-66c6-475d-93a2-c13d9d5cfc0b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:19.978179 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-85c6dc54-f8f3-433d-8499-596ccf953e95 req-f0fa2372-66c6-475d-93a2-c13d9d5cfc0b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:19.989539 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-85c6dc54-f8f3-433d-8499-596ccf953e95 req-f0fa2372-66c6-475d-93a2-c13d9d5cfc0b service nova] Creating event network-changed:1eba2ad4-a45b-4aba-acd3-de14483ba311 for instance f60f66c3-3910-4b50-93c8-254aa931e10c on hv-cinder-81735 Nov 19 13:45:19.994393 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-85c6dc54-f8f3-433d-8499-596ccf953e95 req-f0fa2372-66c6-475d-93a2-c13d9d5cfc0b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029589 Nov 19 13:45:19.994974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 556/1121] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:45:43.453653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:45:43.454288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:45:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:45:47.567044 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:47.567720 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:47.574043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:47.574469 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:47.575321 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:47.575749 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:47.601968 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:45:47.686650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-98ab5921-b0c1-40c0-b48c-80b86b8f366a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 204 len: 0 microversion: 2.1 time: 0.124021 Nov 19 13:45:47.687290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 566/1122] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:45:47 2021] DELETE /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:45:47.697472 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:47.698139 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:47.705025 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:47.705486 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:47.706260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:47.706709 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:47.860952 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:47.869223 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f685fd0e-2116-452d-a5e0-16d3c987db09 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1579 microversion: 2.1 time: 0.176502 Nov 19 13:45:47.869831 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 557/1123] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:47 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:45:48.887224 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:48.887891 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:48.895959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:48.896542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:48.897564 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:48.898107 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:49.054139 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:49.062641 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1c036560-a653-40aa-9a92-ab9fd137c536 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1579 microversion: 2.1 time: 0.179613 Nov 19 13:45:49.063221 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 567/1124] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:48 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:50.081853 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:50.082476 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:50.088997 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:50.089430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:50.090223 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:50.090664 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:50.440343 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:50.447904 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-96833688-c262-4f4a-8625-07fdefe12cac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 200 len: 1511 microversion: 2.1 time: 0.370439 Nov 19 13:45:50.448457 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 558/1125] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:50 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:50.551290 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-dd3f10e0-ea03-4a07-95ac-0295ea586130 req-f66029b0-569a-420f-bf43-e09ce74fda68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef224f6-580f-4fd7-8f80-8e580dc79b2c", "name": "network-vif-deleted", "tag": "9a9d1cdc-1baa-46a7-bc17-23842379e031"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:50.552815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:45:50.552815 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:45:50.562149 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-dd3f10e0-ea03-4a07-95ac-0295ea586130 req-f66029b0-569a-420f-bf43-e09ce74fda68 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:50.562804 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-dd3f10e0-ea03-4a07-95ac-0295ea586130 req-f66029b0-569a-420f-bf43-e09ce74fda68 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:50.576044 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-dd3f10e0-ea03-4a07-95ac-0295ea586130 req-f66029b0-569a-420f-bf43-e09ce74fda68 service nova] Creating event network-vif-deleted:9a9d1cdc-1baa-46a7-bc17-23842379e031 for instance fef224f6-580f-4fd7-8f80-8e580dc79b2c on hv-cinder-81735 Nov 19 13:45:50.586043 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-dd3f10e0-ea03-4a07-95ac-0295ea586130 req-f66029b0-569a-420f-bf43-e09ce74fda68 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039456 Nov 19 13:45:50.586917 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 568/1126] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:45:51.465541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:51.466337 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:51.474270 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:51.474732 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:51.475615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:51.476044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:51.491124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] HTTP exception thrown: Instance fef224f6-580f-4fd7-8f80-8e580dc79b2c could not be found. Nov 19 13:45:51.491758 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Returning 404 to user: Instance fef224f6-580f-4fd7-8f80-8e580dc79b2c could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:45:51.492646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-be8f249b-1f0c-4b56-b4c6-2f16afd3dd0b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 404 len: 111 microversion: 2.1 time: 0.031153 Nov 19 13:45:51.493195 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 559/1127] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:51 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:45:51.589813 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1402844692", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-589091822", "security_groups": [{"name": "tempest-secgroup-smoke-1976351387"}], "block_device_mapping_v2": [{"uuid": "f0f52223-f2db-45bc-bd64-4c807048a6fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e99b515c-40f9-48bf-80e5-bf33416424d2"}]}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:51.707952 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.network.neutron [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] validate_networks() for [('e99b515c-40f9-48bf-80e5-bf33416424d2', None, None, None, None, None)] {{(pid=122814) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:45:52.131112 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Flavor limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:45:52.131545 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Image limits 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:45:52.132025 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Flavor pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:45:52.132410 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Image pref 0:0:0 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:45:52.132816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.virt.hardware [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:45:52.142757 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:52.143239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:52.144035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:52.144461 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:52.161619 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:45:52.166009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.quota [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for user da4e222a82204884973d0f20621d1c3c and project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=122814) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:45:52.224176 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Going to run 1 instances... {{(pid=122814) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:45:52.226489 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0f52223-f2db-45bc-bd64-4c807048a6fd',volume_size=None,volume_type=None)] {{(pid=122814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:45:52.369212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-9724e5cf-bbc9-4ee9-90a5-a249c7298587 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783412 Nov 19 13:45:52.369853 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 569/1128] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:45:51 2021] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:45:52.379921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-523e1d34-5816-46e5-b698-05c543dd769e tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:52.380541 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-523e1d34-5816-46e5-b698-05c543dd769e tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:52.434447 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-523e1d34-5816-46e5-b698-05c543dd769e tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:52.441960 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-523e1d34-5816-46e5-b698-05c543dd769e tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1094 microversion: 2.1 time: 0.065795 Nov 19 13:45:52.442680 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 560/1129] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:52 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:53.459203 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:53.460493 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:53.467467 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:53.468176 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:53.469245 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:53.469867 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:53.574828 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:53.582493 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a7a39bac-624c-4c71-8e24-0fe60356de62 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1210 microversion: 2.1 time: 0.127792 Nov 19 13:45:53.583037 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 570/1130] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:53 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:54.604241 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:54.605134 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:54.613498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:54.614305 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:54.615183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:54.615613 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:54.852533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-1740a025-a0e5-4b83-9b47-6a522df24360 req-ce349bc3-6956-4bf0-ac3d-b06546b726c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88", "tag": "005267b9-ac74-490b-9a02-99fa0411a3a4"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:45:54.855125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:45:54.855125 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:45:54.871155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1740a025-a0e5-4b83-9b47-6a522df24360 req-ce349bc3-6956-4bf0-ac3d-b06546b726c2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:54.871893 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1740a025-a0e5-4b83-9b47-6a522df24360 req-ce349bc3-6956-4bf0-ac3d-b06546b726c2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:54.883979 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-1740a025-a0e5-4b83-9b47-6a522df24360 req-ce349bc3-6956-4bf0-ac3d-b06546b726c2 service nova] Creating event network-changed:005267b9-ac74-490b-9a02-99fa0411a3a4 for instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 on hv-cinder-81735 Nov 19 13:45:54.889500 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-1740a025-a0e5-4b83-9b47-6a522df24360 req-ce349bc3-6956-4bf0-ac3d-b06546b726c2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041583 Nov 19 13:45:54.890122 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 571/1131] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:45:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:45:54.902976 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:54.912416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e420a8dc-8411-48be-ae55-0ad558f9f704 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.316250 Nov 19 13:45:54.913242 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 561/1132] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:54 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:55.935878 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:55.937009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:55.947996 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:55.948729 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:55.950101 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:55.950872 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:56.108078 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:56.116007 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cc4b8832-2577-4ad3-85fa-2bd6c92158dc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.187915 Nov 19 13:45:56.116569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 572/1133] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:55 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:57.133379 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:57.134016 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:57.140843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:57.141315 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:57.142117 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:57.142563 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:57.282078 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:57.290019 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4e152aba-c66b-48ba-b142-5a2f26a33352 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.160552 Nov 19 13:45:57.290586 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 562/1134] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:57 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:58.312307 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:58.313036 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:58.321779 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:58.322229 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:58.323041 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:58.324473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:58.495753 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:58.504515 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e9e872f2-0794-43fd-9c24-39edb1c43985 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.198149 Nov 19 13:45:58.505134 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 573/1135] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:58 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:45:59.526311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:45:59.527076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:45:59.534864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:59.535350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:59.536136 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:45:59.536568 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:45:59.681872 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:45:59.693928 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-ac8d3e9b-1af6-475a-b1c1-db456a5502ef tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.171831 Nov 19 13:45:59.694720 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 563/1136] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:45:59 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:00.717919 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:00.718630 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:00.725654 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:00.726101 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:00.726875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:00.727335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:00.875115 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:00.883618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8db49a24-7106-4bc4-b069-0ac9964a4b07 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.171420 Nov 19 13:46:00.884216 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 574/1137] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:00 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:01.901400 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:01.902059 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:01.908938 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:01.909384 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:01.910185 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:01.910626 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:02.054260 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:02.062178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-dba059f9-9403-4812-91d7-e4f677e382cb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.164901 Nov 19 13:46:02.062741 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 564/1138] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:01 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:03.087909 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:03.088871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:03.097846 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:03.098303 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:03.099118 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:03.099578 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:03.248742 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:03.257185 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d3884d34-d758-4a84-9732-a669b3c86356 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.175772 Nov 19 13:46:03.257789 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 575/1139] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:03 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:04.274034 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:04.274763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:04.281706 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:04.282138 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:04.283051 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:04.283516 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:04.476314 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:04.488054 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b521b9af-b21e-49a8-8934-19a47f29fa0a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.217494 Nov 19 13:46:04.488756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 565/1140] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:04 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:05.513341 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:05.514369 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:05.522505 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:05.523061 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:05.524024 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:05.524638 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:05.727404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:05.736144 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-88a1f934-7f37-4a24-815f-a947c303451b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.226771 Nov 19 13:46:05.736703 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 576/1141] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:05 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:06.379615 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-a496b076-341e-45b7-a0c9-f953f3a2b382 req-a539663c-e4fd-43be-bdf2-c9c59f2dc8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88", "name": "network-vif-plugged", "status": "completed", "tag": "005267b9-ac74-490b-9a02-99fa0411a3a4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:46:06.381334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:46:06.381334 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:46:06.389492 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-a496b076-341e-45b7-a0c9-f953f3a2b382 req-a539663c-e4fd-43be-bdf2-c9c59f2dc8e5 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:06.389977 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-a496b076-341e-45b7-a0c9-f953f3a2b382 req-a539663c-e4fd-43be-bdf2-c9c59f2dc8e5 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:06.402133 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-a496b076-341e-45b7-a0c9-f953f3a2b382 req-a539663c-e4fd-43be-bdf2-c9c59f2dc8e5 service nova] Creating event network-vif-plugged:005267b9-ac74-490b-9a02-99fa0411a3a4 for instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 on hv-cinder-81735 Nov 19 13:46:06.408367 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-a496b076-341e-45b7-a0c9-f953f3a2b382 req-a539663c-e4fd-43be-bdf2-c9c59f2dc8e5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032803 Nov 19 13:46:06.409004 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 566/1142] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:46:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:46:06.754457 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:06.755056 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:06.762191 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:06.762643 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:06.763582 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:06.764048 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:06.922150 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:06.934633 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c1cd6338-bc24-4f97-b7f8-f36f58028984 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1266 microversion: 2.1 time: 0.184872 Nov 19 13:46:06.935547 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 577/1143] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:06 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:07.005995 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:46:07.006241 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:46:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:46:07.956505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:07.957289 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:07.964726 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:07.965404 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:07.966536 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:07.967239 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:08.111859 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:08.120298 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1f5f2146-ea57-4443-9359-bd0178c4c0ff tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1453 microversion: 2.1 time: 0.169631 Nov 19 13:46:08.120870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 567/1144] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:07 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:08.137059 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:46:08.137648 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:46:08.144279 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:08.144732 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:08.145517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:08.145957 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:08.293579 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:46:08.305280 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cb8e40ae-77fb-47f5-898f-884be6134fc1 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1453 microversion: 2.1 time: 0.171585 Nov 19 13:46:08.306164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 578/1145] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:46:08 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:46:10.331396 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-ae672637-5e0d-4cf2-bdf4-86dc31743df4 req-f1e5c6ad-9318-45e6-9e3a-22c9d3ace6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88", "tag": "005267b9-ac74-490b-9a02-99fa0411a3a4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:46:10.332880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:46:10.332880 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:46:10.340152 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-ae672637-5e0d-4cf2-bdf4-86dc31743df4 req-f1e5c6ad-9318-45e6-9e3a-22c9d3ace6c2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:46:10.340576 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-ae672637-5e0d-4cf2-bdf4-86dc31743df4 req-f1e5c6ad-9318-45e6-9e3a-22c9d3ace6c2 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:46:10.351869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-ae672637-5e0d-4cf2-bdf4-86dc31743df4 req-f1e5c6ad-9318-45e6-9e3a-22c9d3ace6c2 service nova] Creating event network-changed:005267b9-ac74-490b-9a02-99fa0411a3a4 for instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 on hv-cinder-81735 Nov 19 13:46:10.359851 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-ae672637-5e0d-4cf2-bdf4-86dc31743df4 req-f1e5c6ad-9318-45e6-9e3a-22c9d3ace6c2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031974 Nov 19 13:46:10.360202 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 568/1146] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:46:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:47:15.814167 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:47:15.814835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:15.822183 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:15.822643 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:15.823460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:15.823895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:15.846941 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lazy-loading 'flavor' on Instance uuid f60f66c3-3910-4b50-93c8-254aa931e10c {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:47:15.930793 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fabaf4f5-6d23-4325-8418-b0295def5a9e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "POST /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c/action" status: 202 len: 0 microversion: 2.1 time: 0.123865 Nov 19 13:47:15.931414 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 579/1147] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:47:15 2021] POST /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:47:15.941817 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:15.942848 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:15.949446 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:15.949971 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:15.950783 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:15.951311 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:16.113677 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:16.122548 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d1529bb4-ba88-4a6c-ae59-a5f22dddfa20 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.186317 Nov 19 13:47:16.123143 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 569/1148] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:15 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:17.142704 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:17.143541 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:17.150727 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:17.151220 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:17.152013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:17.152446 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:17.289998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:17.302177 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-390ed81d-f056-4e82-847d-2a67d2b5f79a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.165141 Nov 19 13:47:17.303524 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 580/1149] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:17 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:18.323589 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:18.324156 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:18.331356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:18.331900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:18.333047 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:18.333706 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:18.507137 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:18.517497 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-44862899-cf02-4d01-913d-6a6ed38b1ee5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.200079 Nov 19 13:47:18.518357 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 570/1150] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:18 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:19.543709 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:19.544743 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:19.556808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:19.556808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:19.557297 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:19.557618 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:19.710558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:19.724309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3cbf9bc1-c2e2-4d06-b20d-42bf3231e917 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.186673 Nov 19 13:47:19.725228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 581/1151] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:19 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:20.746517 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:20.747463 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:20.757911 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:20.758641 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:20.759483 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:20.759919 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:20.914555 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:20.922717 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-72e994c5-2121-44ef-a310-1a76038f883a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.182833 Nov 19 13:47:20.923724 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 571/1152] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:20 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:21.941329 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:21.942266 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:21.950596 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:21.950809 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:21.951490 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:21.951921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:22.106871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:22.118594 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4679d79f-ce8f-43aa-8af0-d618aaf8cf0a tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.181547 Nov 19 13:47:22.119325 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 582/1153] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:21 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:23.144920 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:23.146048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:23.154471 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:23.154929 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:23.155767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:23.156202 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:23.301145 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:23.309499 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-eb7850cb-6eef-4611-bf7b-7ba8c290dcb7 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.170959 Nov 19 13:47:23.310048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 572/1154] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:23 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:24.336380 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:24.337314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:24.348358 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:24.349112 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:24.350422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:24.351188 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:24.493877 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:24.501805 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-e34a4938-44e3-4f0a-bfb2-aada2f5bc833 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.171772 Nov 19 13:47:24.502395 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 583/1155] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:24 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:25.522036 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:25.522661 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:25.529945 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:25.530404 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:25.531243 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:25.531682 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:25.695342 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:25.703472 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-252425a6-cf16-4922-86d6-70065cfc2f73 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.185271 Nov 19 13:47:25.704045 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 573/1156] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:25 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:26.722082 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:26.722653 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:26.729962 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:26.730445 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:26.731271 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:26.731708 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:26.881200 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:26.889231 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a11e0955-a367-4cf3-ba8b-f5a9dcd9be13 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.171128 Nov 19 13:47:26.889803 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 584/1157] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:26 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:27.908505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:27.909294 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:27.917829 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:27.918395 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:27.919646 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:27.919992 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:28.064618 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:28.072356 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d89c5754-b407-4dcc-86d2-4643e061a35e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.168472 Nov 19 13:47:28.072893 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 574/1158] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:27 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:29.092841 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:29.093528 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:29.101805 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:29.102378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:29.104725 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:29.105383 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:29.253109 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:29.261764 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-028e2b42-8efa-46e9-b295-b399b8075ed5 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1510 microversion: 2.1 time: 0.173663 Nov 19 13:47:29.262344 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 585/1159] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:29 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:29.282772 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:47:29.283398 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:29.290202 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:29.290651 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:29.291490 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:29.291923 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:29.386198 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-44cff47b-4206-4bb9-bc54-20b674db1843 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "POST /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c/action" status: 202 len: 0 microversion: 2.1 time: 0.107292 Nov 19 13:47:29.386793 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 575/1160] 10.222.0.74 () {60 vars in 1277 bytes} [Fri Nov 19 13:47:29 2021] POST /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:47:29.394835 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:29.395473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:29.401600 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:29.402053 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:29.402841 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:29.403314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:29.558917 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:29.566793 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-a8532171-3e80-40fd-a6e1-cab856cc7dd0 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1518 microversion: 2.1 time: 0.175618 Nov 19 13:47:29.567394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 586/1161] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:29 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:30.588917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:30.589556 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:30.596216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:30.596673 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:30.597458 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:30.597897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:30.736268 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:30.743990 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-79ce4504-ab88-4b76-8c91-8f6c053f6e77 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1518 microversion: 2.1 time: 0.161594 Nov 19 13:47:30.744921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 576/1162] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:30 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:31.764608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:31.765309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:31.773530 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:31.774087 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:31.775064 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:31.775764 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:31.923315 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:31.930714 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-7102112d-db30-4973-9d5d-de4356f415f9 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1518 microversion: 2.1 time: 0.171590 Nov 19 13:47:31.931360 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 587/1163] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:31 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:32.810177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-ae155515-a180-41fb-87b9-58120dc96e7a req-65126bed-2659-4704-a697-bded3e6b5a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "name": "network-vif-unplugged", "status": "completed", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:47:32.811757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:47:32.811757 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:47:32.818778 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-ae155515-a180-41fb-87b9-58120dc96e7a req-65126bed-2659-4704-a697-bded3e6b5a6e service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:32.819246 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-ae155515-a180-41fb-87b9-58120dc96e7a req-65126bed-2659-4704-a697-bded3e6b5a6e service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:32.832121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.compute.server_external_events [req-ae155515-a180-41fb-87b9-58120dc96e7a req-65126bed-2659-4704-a697-bded3e6b5a6e service nova] Unable to find a host for instance f60f66c3-3910-4b50-93c8-254aa931e10c. Dropping event network-vif-unplugged {{(pid=122815) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 19 13:47:32.832993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-ae155515-a180-41fb-87b9-58120dc96e7a req-65126bed-2659-4704-a697-bded3e6b5a6e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.088429 Nov 19 13:47:32.833899 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 577/1164] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 19 13:47:32.950823 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:32.951438 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:32.960153 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:32.960599 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:32.961373 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:32.961816 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:33.099895 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:33.108311 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d068ac57-12ca-4c96-81b1-d9b02ffbf3d1 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1518 microversion: 2.1 time: 0.163442 Nov 19 13:47:33.108894 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 588/1165] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:32 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:34.126350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:34.126964 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:34.133825 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:34.134279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:34.135060 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:34.135591 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:34.286100 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:34.293958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b551db22-d746-4c7a-b41d-5f822f0c6038 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1518 microversion: 2.1 time: 0.171525 Nov 19 13:47:34.294517 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 578/1166] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:34 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:35.312119 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:35.312695 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:35.319459 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:35.319915 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:35.320712 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:35.321145 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:35.533734 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:35.543184 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-28a8d3dc-e975-428a-831d-071e24718d76 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.234919 Nov 19 13:47:35.543862 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 589/1167] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:35 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:36.568434 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:36.569261 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:36.578466 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:36.579087 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:36.580212 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:36.580816 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:36.722301 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:36.734788 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2dc2a7dc-4503-49ca-9de5-21298349fede tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.171222 Nov 19 13:47:36.735643 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 579/1168] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:36 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:37.752968 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:37.753569 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:37.760415 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:37.760870 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:37.761733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:37.762109 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:37.902307 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:37.910204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1b4bd713-4523-4000-8aa9-837d9a2a12e4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.161349 Nov 19 13:47:37.910821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 590/1169] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:37 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:38.928354 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:38.928968 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:38.936048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:38.936505 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:38.937308 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:38.937741 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:39.091752 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:39.099870 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-fb05123a-37a5-4cc1-ace9-6913b819bbab tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.175352 Nov 19 13:47:39.100426 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 580/1170] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:38 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:40.120869 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:40.121796 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:40.131575 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:40.132210 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:40.133318 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:40.133921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:40.280085 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:40.288372 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cd844caf-541c-499f-9341-0f540bc32455 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.173031 Nov 19 13:47:40.288954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 591/1171] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:40 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:41.312203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:41.312782 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:41.319703 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:41.320250 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:41.321040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:41.321475 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:41.471767 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:41.479927 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-bc4c731e-1c5b-4b1d-bfc8-8ef85894228f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.171759 Nov 19 13:47:41.480479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 581/1172] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:41 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:42.499364 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:42.500651 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:42.506885 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:42.507403 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:42.508193 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:42.508650 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:42.645399 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:42.653503 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-52ec7990-3726-4d78-8aeb-7286b9c164ea tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.158772 Nov 19 13:47:42.658541 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 592/1173] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:42 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:43.671419 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:43.671997 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:43.679161 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:43.679634 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:43.680429 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:43.680869 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:43.828934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:43.840453 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-5c42733c-1985-43f2-b837-a347c1a39488 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.173331 Nov 19 13:47:43.841249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 582/1174] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:43 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:44.859047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:44.859827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:44.866274 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:44.866717 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:44.867533 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:44.867960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:45.004981 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:45.012382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-343303a0-c634-4b48-82f1-8c7b7f1a2fd4 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.157634 Nov 19 13:47:45.013102 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 593/1175] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:44 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:45.923444 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-238304424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-589091822", "security_groups": [{"name": "tempest-secgroup-smoke-1976351387"}], "block_device_mapping_v2": [{"uuid": "ae4c257c-4a0a-4a17-8374-ed8539e96684", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e99b515c-40f9-48bf-80e5-bf33416424d2"}]}} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:47:46.028608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:46.029382 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:46.035558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:46.035887 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:46.036680 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:46.037087 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:46.037249 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.network.neutron [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] validate_networks() for [('e99b515c-40f9-48bf-80e5-bf33416424d2', None, None, None, None, None)] {{(pid=122815) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 13:47:46.262298 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:46.270538 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3a9ccfc7-84ae-441d-9861-2cd2315ea061 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.245640 Nov 19 13:47:46.271519 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 594/1176] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:46 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:47:46.817066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Flavor limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 13:47:46.817494 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Image limits 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 13:47:46.818013 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Flavor pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 13:47:46.818400 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Image pref 0:0:0 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 13:47:46.818827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.virt.hardware [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 13:47:46.828288 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:46.828765 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:46.829566 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:46.829993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:46.846100 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 13:47:46.849974 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.quota [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Getting quotas for user da4e222a82204884973d0f20621d1c3c and project 783e37f036a74f1d815332aa4c5a8a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=122815) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 13:47:46.884954 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-31efec7a-4d83-4053-9ccc-6709260751bc req-fe47808c-3923-4e40-ac21-61456d10250e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "name": "network-vif-plugged", "status": "completed", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:47:46.887898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:47:46.887898 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:47:46.895960 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-31efec7a-4d83-4053-9ccc-6709260751bc req-fe47808c-3923-4e40-ac21-61456d10250e service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:46.896407 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-31efec7a-4d83-4053-9ccc-6709260751bc req-fe47808c-3923-4e40-ac21-61456d10250e service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:46.912461 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Going to run 1 instances... {{(pid=122815) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 13:47:46.912821 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-31efec7a-4d83-4053-9ccc-6709260751bc req-fe47808c-3923-4e40-ac21-61456d10250e service nova] Creating event network-vif-plugged:1eba2ad4-a45b-4aba-acd3-de14483ba311 for instance f60f66c3-3910-4b50-93c8-254aa931e10c on hv-cinder-81735 Nov 19 13:47:46.915827 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae4c257c-4a0a-4a17-8374-ed8539e96684',volume_size=None,volume_type=None)] {{(pid=122815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 13:47:46.920199 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-31efec7a-4d83-4053-9ccc-6709260751bc req-fe47808c-3923-4e40-ac21-61456d10250e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038889 Nov 19 13:47:46.921230 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 595/1177] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:47:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:47:47.084317 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-4eba3ae7-3aba-447e-abfd-fca133894078 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.164864 Nov 19 13:47:47.084979 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 583/1178] 10.222.0.74 () {60 vars in 1146 bytes} [Fri Nov 19 13:47:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 13:47:47.096164 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d84f2f4e-18e2-4737-8b02-f47096ffb102 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:47.097009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d84f2f4e-18e2-4737-8b02-f47096ffb102 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:47.166228 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d84f2f4e-18e2-4737-8b02-f47096ffb102 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:47.175289 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d84f2f4e-18e2-4737-8b02-f47096ffb102 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1093 microversion: 2.1 time: 0.083648 Nov 19 13:47:47.175873 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 596/1179] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:47 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:47.290964 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:47.291722 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:47.300117 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:47.300629 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:47.301438 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:47.301843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:47.456217 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:47.464010 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b7d0b628-78ad-4ec2-8cdf-bf164f871dc8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1576 microversion: 2.1 time: 0.178903 Nov 19 13:47:47.464590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 584/1180] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:47 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:48.194422 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:48.195168 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:48.206197 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:48.206661 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:48.207580 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:48.208413 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:48.283212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:48.291013 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b61d5fd3-df40-4f00-9b5c-b1da78636eec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1209 microversion: 2.1 time: 0.102144 Nov 19 13:47:48.291655 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 597/1181] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:48 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:48.481342 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:48.481907 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:48.488711 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:48.489184 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:48.489983 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:48.490416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:48.737157 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:48.744593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-0479f768-67d2-4bd5-a2af-a890b2dd35c8 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1563 microversion: 2.1 time: 0.267174 Nov 19 13:47:48.745169 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 585/1182] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:48 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1563 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:49.314740 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:49.315379 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:49.322052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:49.322461 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:49.323616 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:49.324052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:49.559067 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:49.566733 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8762afc7-0c89-48dd-9778-939013432bf5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.255906 Nov 19 13:47:49.567365 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 598/1183] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:49 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:49.776164 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-f6f6b9ce-d147-43c2-a76a-3636f78bd0e1 req-1926bebb-a66d-4d28-87c4-ac8b9ee90070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e693bd7d-1fc7-48a6-a193-5f7e51aa246e", "tag": "4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:47:49.778689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:47:49.778689 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:47:49.786341 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-f6f6b9ce-d147-43c2-a76a-3636f78bd0e1 req-1926bebb-a66d-4d28-87c4-ac8b9ee90070 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:49.787004 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-f6f6b9ce-d147-43c2-a76a-3636f78bd0e1 req-1926bebb-a66d-4d28-87c4-ac8b9ee90070 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:49.799066 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-f6f6b9ce-d147-43c2-a76a-3636f78bd0e1 req-1926bebb-a66d-4d28-87c4-ac8b9ee90070 service nova] Creating event network-changed:4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4 for instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e on hv-cinder-81735 Nov 19 13:47:49.804713 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-f6f6b9ce-d147-43c2-a76a-3636f78bd0e1 req-1926bebb-a66d-4d28-87c4-ac8b9ee90070 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110870 Nov 19 13:47:49.805590 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 586/1184] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:47:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:47:50.585906 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:50.586517 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:50.594562 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:50.595015 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:50.595830 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:50.596261 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:50.772300 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:50.780319 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-4cea0edd-88d2-453f-a94f-37a6f24b39cf tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.200478 Nov 19 13:47:50.780900 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 599/1185] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:50 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:51.802303 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:51.803231 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:51.811748 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:51.812203 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:51.812993 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:51.813432 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:51.974079 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:51.983887 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-f48054df-60f6-4c86-88f0-969a14b3135b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.188081 Nov 19 13:47:51.984843 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 587/1186] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:51 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:53.003440 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:53.004054 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:53.013344 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:53.013901 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:53.015035 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:53.015696 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:53.162398 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:53.174542 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-6454f453-e945-4f6a-82d7-06034bdf1154 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.176386 Nov 19 13:47:53.175478 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 600/1187] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:52 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:54.198900 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:54.199811 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:54.207048 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:54.207533 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:54.208326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:54.208764 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:54.363838 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:54.371484 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-e94a76a1-98a7-425c-8897-6811834adf33 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.178022 Nov 19 13:47:54.372279 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 588/1188] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:54 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:55.390973 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:55.391617 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:55.399274 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:55.399819 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:55.400854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:55.404887 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:55.571601 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:55.579883 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3a1fd35a-697b-4844-8e32-2686e0c2347c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.194407 Nov 19 13:47:55.580486 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 601/1189] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:55 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:56.603076 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:56.604135 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:56.613319 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:56.614020 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:56.615227 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:56.615878 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:56.770984 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:56.779508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-b2755a37-63f4-4351-b58a-14f8ccf3b55a tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.182617 Nov 19 13:47:56.780206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 589/1190] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:56 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:57.800505 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:57.801145 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:57.810959 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:57.811447 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:57.812241 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:57.812674 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:57.973883 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:57.982047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-0f528184-102f-477f-8911-177c1be9dbe9 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.188248 Nov 19 13:47:57.982810 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 602/1191] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:57 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:47:58.999739 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:47:59.000351 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:47:59.007780 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:59.008251 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:59.009055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:47:59.009489 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:47:59.158181 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:47:59.165814 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-73937615-eadf-4149-9f61-cb011a3225cc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.170100 Nov 19 13:47:59.166430 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 590/1192] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:47:58 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:48:00.183155 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:48:00.183808 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:48:00.190558 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:00.191009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:00.191811 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:00.192244 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:00.337550 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:48:00.347997 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d5723c8d-7ad2-44de-96aa-46675d73a7fa tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.168284 Nov 19 13:48:00.348871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 603/1193] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:48:00 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:48:00.988633 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-204caebe-3f5c-42fa-9941-f10a13f86a03 req-4c2d6362-2d08-4846-aef4-65a81a2c822f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e693bd7d-1fc7-48a6-a193-5f7e51aa246e", "name": "network-vif-plugged", "status": "completed", "tag": "4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:48:00.990273 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:48:00.990515 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:48:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Nov 19 13:48:01.002908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:48:01.002908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:48:01.012124 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-204caebe-3f5c-42fa-9941-f10a13f86a03 req-4c2d6362-2d08-4846-aef4-65a81a2c822f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:01.012578 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-204caebe-3f5c-42fa-9941-f10a13f86a03 req-4c2d6362-2d08-4846-aef4-65a81a2c822f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:01.028942 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-204caebe-3f5c-42fa-9941-f10a13f86a03 req-4c2d6362-2d08-4846-aef4-65a81a2c822f service nova] Creating event network-vif-plugged:4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4 for instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e on hv-cinder-81735 Nov 19 13:48:01.035594 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-204caebe-3f5c-42fa-9941-f10a13f86a03 req-4c2d6362-2d08-4846-aef4-65a81a2c822f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050879 Nov 19 13:48:01.037206 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 591/1194] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:48:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:48:01.365581 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:48:01.366196 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:48:01.374384 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:01.374871 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:01.375683 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:01.376314 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:01.551458 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:48:01.562034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d19d77e3-f943-4952-93f2-4cd7d8267483 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1265 microversion: 2.1 time: 0.200287 Nov 19 13:48:01.562608 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 604/1195] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:48:01 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:48:02.588276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:48:02.589301 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:48:02.599616 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:02.600245 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:02.601468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:02.602009 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:02.744439 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:48:02.753328 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-54d4d204-c759-4e76-b326-8733daefd5da tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1452 microversion: 2.1 time: 0.172503 Nov 19 13:48:02.753895 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 592/1196] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:48:02 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:48:02.772141 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:48:02.772709 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:48:02.781640 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:02.782095 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:02.782880 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:02.783334 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:02.942918 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:48:02.958483 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-1ef3e362-585c-4000-86dd-52558fe564b2 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1452 microversion: 2.1 time: 0.191604 Nov 19 13:48:02.959204 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 605/1197] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:48:02 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:48:04.970262 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-d612ee2d-f283-4ac5-b078-334291bb13c5 req-19505553-3dd6-4ada-a4e6-033608b32caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e693bd7d-1fc7-48a6-a193-5f7e51aa246e", "tag": "4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:48:04.971904 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:48:04.971904 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:48:04.978705 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-d612ee2d-f283-4ac5-b078-334291bb13c5 req-19505553-3dd6-4ada-a4e6-033608b32caa service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:48:04.979196 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-d612ee2d-f283-4ac5-b078-334291bb13c5 req-19505553-3dd6-4ada-a4e6-033608b32caa service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:48:04.990317 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-d612ee2d-f283-4ac5-b078-334291bb13c5 req-19505553-3dd6-4ada-a4e6-033608b32caa service nova] Creating event network-changed:4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4 for instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e on hv-cinder-81735 Nov 19 13:48:04.995403 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-d612ee2d-f283-4ac5-b078-334291bb13c5 req-19505553-3dd6-4ada-a4e6-033608b32caa service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032232 Nov 19 13:48:04.996003 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 593/1198] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:48:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:49:03.473860 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:49:03.474555 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:49:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:49:05.471481 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:05.472114 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:05.478851 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:05.479345 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:05.480131 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:05.480622 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:05.507068 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:49:05.597876 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d8560bae-de07-436d-8f9f-a17af50adf61 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 204 len: 0 microversion: 2.1 time: 0.131392 Nov 19 13:49:05.599056 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 606/1199] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:49:05 2021] DELETE /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:49:05.609106 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:05.610040 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:05.610965 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-9f6e31e2-4f1b-4978-af1d-8cb4ac1c94de req-377c3112-eb31-4a79-875e-81bd66c26a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:49:05.612479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:49:05.612479 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:49:05.616950 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:05.617536 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:05.618560 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:05.619178 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:05.623982 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-9f6e31e2-4f1b-4978-af1d-8cb4ac1c94de req-377c3112-eb31-4a79-875e-81bd66c26a4b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:05.624426 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-9f6e31e2-4f1b-4978-af1d-8cb4ac1c94de req-377c3112-eb31-4a79-875e-81bd66c26a4b service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:05.636802 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-9f6e31e2-4f1b-4978-af1d-8cb4ac1c94de req-377c3112-eb31-4a79-875e-81bd66c26a4b service nova] Creating event network-changed:1eba2ad4-a45b-4aba-acd3-de14483ba311 for instance f60f66c3-3910-4b50-93c8-254aa931e10c on hv-cinder-81735 Nov 19 13:49:05.642714 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-9f6e31e2-4f1b-4978-af1d-8cb4ac1c94de req-377c3112-eb31-4a79-875e-81bd66c26a4b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173903 Nov 19 13:49:05.643468 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 594/1200] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:49:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:49:05.854285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:05.864019 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-72191df1-2006-42af-8760-9214992c3973 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1569 microversion: 2.1 time: 0.259771 Nov 19 13:49:05.874522 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 607/1201] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:05 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:49:06.884921 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:06.885546 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:06.893292 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:06.893934 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:06.894917 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:06.895611 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:07.046228 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:07.054429 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-be1a347c-5d1c-4c99-8b62-9ac5a57c2397 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1451 microversion: 2.1 time: 0.175898 Nov 19 13:49:07.055044 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 595/1202] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:06 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:49:07.668724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [req-1edfb8c7-db84-42c1-ae8e-5fc7e554f6ce req-abc5fa97-a78d-41c7-b2ca-e1b8b7181d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60f66c3-3910-4b50-93c8-254aa931e10c", "name": "network-vif-deleted", "tag": "1eba2ad4-a45b-4aba-acd3-de14483ba311"}]} {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:49:07.670309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:49:07.670309 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: warnings.warn(msg) Nov 19 13:49:07.678080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1edfb8c7-db84-42c1-ae8e-5fc7e554f6ce req-abc5fa97-a78d-41c7-b2ca-e1b8b7181d9d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:07.678514 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [req-1edfb8c7-db84-42c1-ae8e-5fc7e554f6ce req-abc5fa97-a78d-41c7-b2ca-e1b8b7181d9d service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:07.690212 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.compute.server_external_events [req-1edfb8c7-db84-42c1-ae8e-5fc7e554f6ce req-abc5fa97-a78d-41c7-b2ca-e1b8b7181d9d service nova] Creating event network-vif-deleted:1eba2ad4-a45b-4aba-acd3-de14483ba311 for instance f60f66c3-3910-4b50-93c8-254aa931e10c on hv-cinder-81735 Nov 19 13:49:07.695448 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [req-1edfb8c7-db84-42c1-ae8e-5fc7e554f6ce req-abc5fa97-a78d-41c7-b2ca-e1b8b7181d9d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030602 Nov 19 13:49:07.696030 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 608/1203] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:49:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:49:08.072897 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:08.074156 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:08.081215 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:08.081668 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:08.082498 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:08.082958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:08.116216 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:08.116508 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:08.116999 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.objects.instance [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lazy-loading 'fault' on Instance uuid f60f66c3-3910-4b50-93c8-254aa931e10c {{(pid=122815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:49:08.159358 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b2c44ee4d444f89b74d5a477e1fd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71727a03ae9846e9a726ad93e6670d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:08.167623 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-d155357d-85ef-4a73-9010-9d910f8e519e tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 200 len: 1225 microversion: 2.1 time: 0.098820 Nov 19 13:49:08.167965 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 596/1204] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:08 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:49:09.191598 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:09.192532 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] [instance: f60f66c3-3910-4b50-93c8-254aa931e10c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:09.201034 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:09.201493 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:09.202285 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:09.202724 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:09.216234 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] HTTP exception thrown: Instance f60f66c3-3910-4b50-93c8-254aa931e10c could not be found. Nov 19 13:49:09.216854 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Returning 404 to user: Instance f60f66c3-3910-4b50-93c8-254aa931e10c could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:49:09.217708 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-8a064c25-d500-4e9d-8f26-294057673784 tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c" status: 404 len: 111 microversion: 2.1 time: 0.033374 Nov 19 13:49:09.218237 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 609/1205] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:09 2021] GET /compute/v2.1/servers/f60f66c3-3910-4b50-93c8-254aa931e10c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:49:09.382581 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-1cfd1356-93d3-496a-a82d-138b0444886f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] Calling method '.version_select at 0x7fb429cab9d0>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:09.407719 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-1cfd1356-93d3-496a-a82d-138b0444886f tempest-TestShelveInstance-374202748 tempest-TestShelveInstance-374202748-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1564020743" status: 202 len: 0 microversion: 2.1 time: 0.028804 Nov 19 13:49:09.408338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 597/1206] 10.222.0.74 () {58 vars in 1253 bytes} [Fri Nov 19 13:49:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1564020743 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:49:36.433669 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:36.434239 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:36.436121 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-341358c4-2d59-43da-b80e-227ca50af949 req-f552a185-15ef-4ab9-8f91-42ee76caff85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e693bd7d-1fc7-48a6-a193-5f7e51aa246e", "tag": "4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:49:36.437609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:49:36.437609 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:49:36.441656 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:36.442218 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:36.443107 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:36.443657 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:36.445355 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-341358c4-2d59-43da-b80e-227ca50af949 req-f552a185-15ef-4ab9-8f91-42ee76caff85 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:36.445813 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-341358c4-2d59-43da-b80e-227ca50af949 req-f552a185-15ef-4ab9-8f91-42ee76caff85 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:36.457057 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-341358c4-2d59-43da-b80e-227ca50af949 req-f552a185-15ef-4ab9-8f91-42ee76caff85 service nova] Creating event network-changed:4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4 for instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e on hv-cinder-81735 Nov 19 13:49:36.463276 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-341358c4-2d59-43da-b80e-227ca50af949 req-f552a185-15ef-4ab9-8f91-42ee76caff85 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031679 Nov 19 13:49:36.467970 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 598/1207] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:49:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:49:36.474076 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:49:36.568723 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-c7cb0d35-6394-471b-8dd2-0101c20033bc tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 204 len: 0 microversion: 2.1 time: 0.139434 Nov 19 13:49:36.570473 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 610/1208] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:49:36 2021] DELETE /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:49:36.582063 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:36.582958 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:36.590158 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:36.590658 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:36.591754 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:36.592233 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:36.820183 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:36.828551 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-c8959082-7cb7-4e5b-8d67-9aa9d0e311ac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1576 microversion: 2.1 time: 0.252143 Nov 19 13:49:36.839351 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 599/1209] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:36 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 13:49:37.846776 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:37.847693 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:37.854988 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:37.855549 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:37.856335 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:37.856797 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:38.014955 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:38.026741 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b6653641-016a-423b-aea5-2bb8c751c7fb tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1458 microversion: 2.1 time: 0.183810 Nov 19 13:49:38.027700 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 611/1210] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:37 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1458 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:49:38.622461 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-8eb79cc0-9a17-488a-967b-64b9df26fada req-26ca1e61-f1a3-4c48-aac6-07cb5802d9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e693bd7d-1fc7-48a6-a193-5f7e51aa246e", "name": "network-vif-deleted", "tag": "4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:49:38.624469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:49:38.624469 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:49:38.633089 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-8eb79cc0-9a17-488a-967b-64b9df26fada req-26ca1e61-f1a3-4c48-aac6-07cb5802d9a3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:38.633532 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-8eb79cc0-9a17-488a-967b-64b9df26fada req-26ca1e61-f1a3-4c48-aac6-07cb5802d9a3 service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:38.648283 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-8eb79cc0-9a17-488a-967b-64b9df26fada req-26ca1e61-f1a3-4c48-aac6-07cb5802d9a3 service nova] Creating event network-vif-deleted:4e2ece4c-7bc2-4b31-baf9-24b9b68db2b4 for instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e on hv-cinder-81735 Nov 19 13:49:38.653763 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-8eb79cc0-9a17-488a-967b-64b9df26fada req-26ca1e61-f1a3-4c48-aac6-07cb5802d9a3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040215 Nov 19 13:49:38.654379 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 600/1211] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:49:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:49:39.046091 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:39.046721 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:39.053576 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:39.054049 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:39.054834 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:39.055378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:39.086378 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:39.086826 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:39.087312 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.objects.instance [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lazy-loading 'fault' on Instance uuid e693bd7d-1fc7-48a6-a193-5f7e51aa246e {{(pid=122814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 13:49:39.128264 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:39.136022 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-cb082f75-0c9f-426c-8571-3889badff897 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 200 len: 1229 microversion: 2.1 time: 0.094761 Nov 19 13:49:39.136509 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 612/1212] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:39 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:49:40.161126 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:40.162267 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: e693bd7d-1fc7-48a6-a193-5f7e51aa246e] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:40.173170 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:40.173624 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:40.174472 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:40.174908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:40.188178 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] HTTP exception thrown: Instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e could not be found. Nov 19 13:49:40.188760 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Returning 404 to user: Instance e693bd7d-1fc7-48a6-a193-5f7e51aa246e could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:49:40.189607 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-648f1f99-8bc4-4bce-8f3f-d4a759161410 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e" status: 404 len: 111 microversion: 2.1 time: 0.037438 Nov 19 13:49:40.190147 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 601/1213] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:40 2021] GET /compute/v2.1/servers/e693bd7d-1fc7-48a6-a193-5f7e51aa246e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:49:43.584054 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:43.584587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:43.586188 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-40d06a1c-06c7-48cb-8be3-0176f30186b8 req-c4f4f624-3af2-485f-83ac-f2bf4a558ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88", "tag": "005267b9-ac74-490b-9a02-99fa0411a3a4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:49:43.587642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:49:43.587642 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:49:43.591409 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:43.592065 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:43.593047 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:43.593668 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:43.595285 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-40d06a1c-06c7-48cb-8be3-0176f30186b8 req-c4f4f624-3af2-485f-83ac-f2bf4a558ddd service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:43.595730 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-40d06a1c-06c7-48cb-8be3-0176f30186b8 req-c4f4f624-3af2-485f-83ac-f2bf4a558ddd service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:43.607565 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-40d06a1c-06c7-48cb-8be3-0176f30186b8 req-c4f4f624-3af2-485f-83ac-f2bf4a558ddd service nova] Creating event network-changed:005267b9-ac74-490b-9a02-99fa0411a3a4 for instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 on hv-cinder-81735 Nov 19 13:49:43.612913 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-40d06a1c-06c7-48cb-8be3-0176f30186b8 req-c4f4f624-3af2-485f-83ac-f2bf4a558ddd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030334 Nov 19 13:49:43.613520 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 602/1214] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:49:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 13:49:43.623404 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Going to try to terminate instance {{(pid=122814) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 13:49:43.719858 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-b25a5c21-7c45-4d1c-8cb5-0b2084e256d4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 204 len: 0 microversion: 2.1 time: 0.139707 Nov 19 13:49:43.721080 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 613/1215] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:49:43 2021] DELETE /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 13:49:43.732277 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:43.733067 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:43.741392 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:43.742174 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:43.743055 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:43.743699 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:43.970346 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.policy [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122815) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:43.983040 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-8dedc6f3-c28d-491a-98eb-3c3244536fac tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1578 microversion: 2.1 time: 0.254585 Nov 19 13:49:43.983908 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 603/1216] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:43 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:49:45.003032 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:45.003747 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:45.011475 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:45.012009 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:45.013052 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:45.013671 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:45.179392 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:45.187592 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-d4444230-ad24-4f16-96e5-b540f37f933c tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1459 microversion: 2.1 time: 0.189322 Nov 19 13:49:45.188166 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 614/1217] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:44 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1459 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:49:45.990001 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [req-01ec557d-1a60-4ba0-bf6c-fe069fa2a92e req-182d7fb5-7372-4b8b-ba0a-a80113e89e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88", "name": "network-vif-deleted", "tag": "005267b9-ac74-490b-9a02-99fa0411a3a4"}]} {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 13:49:45.991854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 13:49:45.991854 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: warnings.warn(msg) Nov 19 13:49:46.001858 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-01ec557d-1a60-4ba0-bf6c-fe069fa2a92e req-182d7fb5-7372-4b8b-ba0a-a80113e89e9f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:46.002372 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [req-01ec557d-1a60-4ba0-bf6c-fe069fa2a92e req-182d7fb5-7372-4b8b-ba0a-a80113e89e9f service nova] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:46.014326 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.compute.server_external_events [req-01ec557d-1a60-4ba0-bf6c-fe069fa2a92e req-182d7fb5-7372-4b8b-ba0a-a80113e89e9f service nova] Creating event network-vif-deleted:005267b9-ac74-490b-9a02-99fa0411a3a4 for instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 on hv-cinder-81735 Nov 19 13:49:46.020587 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [req-01ec557d-1a60-4ba0-bf6c-fe069fa2a92e req-182d7fb5-7372-4b8b-ba0a-a80113e89e9f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Nov 19 13:49:46.021177 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 604/1218] 10.222.0.74 () {64 vars in 1317 bytes} [Fri Nov 19 13:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 13:49:46.204924 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:46.205535 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:46.212278 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:46.212689 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:46.213436 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:46.213875 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:46.284431 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.policy [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4e222a82204884973d0f20621d1c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783e37f036a74f1d815332aa4c5a8a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122814) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 13:49:46.292587 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-3f3d09ed-ac88-4320-bf93-bffefbb2428b tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 200 len: 1225 microversion: 2.1 time: 0.091329 Nov 19 13:49:46.293259 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 615/1219] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:46 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 13:49:47.315688 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:47.316350 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:47.323739 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:47.324190 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:47.325005 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:47.325435 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:47.340235 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] HTTP exception thrown: Instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 could not be found. Nov 19 13:49:47.340859 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Returning 404 to user: Instance 6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:49:47.341733 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-37beab01-da93-4f85-8c2a-90a15a5493ec tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88" status: 404 len: 111 microversion: 2.1 time: 0.030389 Nov 19 13:49:47.342416 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 605/1220] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:47 2021] GET /compute/v2.1/servers/6fc0e5e7-ce1d-4662-a42e-2e5c1bda1b88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:49:47.810383 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:47.811038 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.compute.api [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122814) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:47.817754 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:47.818207 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:47.818998 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:47.819460 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG oslo_concurrency.lockutils [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:47.832655 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.wsgi [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] HTTP exception thrown: Instance fef224f6-580f-4fd7-8f80-8e580dc79b2c could not be found. Nov 19 13:49:47.833173 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Returning 404 to user: Instance fef224f6-580f-4fd7-8f80-8e580dc79b2c could not be found. {{(pid=122814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:49:47.833985 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-55348a34-2675-4030-b931-85f3bbcbf4e5 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 404 len: 111 microversion: 2.1 time: 0.027856 Nov 19 13:49:47.834574 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 616/1221] 10.222.0.74 () {58 vars in 1238 bytes} [Fri Nov 19 13:49:47 2021] DELETE /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:49:47.843043 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '>' {{(pid=122815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:47.843693 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.compute.api [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] [instance: fef224f6-580f-4fd7-8f80-8e580dc79b2c] Fetching instance by UUID {{(pid=122815) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 13:49:47.850160 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:47.850611 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:47.851431 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 13:49:47.851864 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG oslo_concurrency.lockutils [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Lock "aa90e9eb-4700-48fd-b538-a6e9cc05f3ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 13:49:47.866593 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.wsgi [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] HTTP exception thrown: Instance fef224f6-580f-4fd7-8f80-8e580dc79b2c could not be found. Nov 19 13:49:47.867218 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: DEBUG nova.api.openstack.wsgi [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Returning 404 to user: Instance fef224f6-580f-4fd7-8f80-8e580dc79b2c could not be found. {{(pid=122815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 13:49:47.868094 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO nova.api.openstack.requestlog [None req-2087908c-4d3f-4238-b2c8-7ef7497dbaf4 tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c" status: 404 len: 111 microversion: 2.1 time: 0.029058 Nov 19 13:49:47.868640 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: [pid: 122815|app: 0|req: 606/1222] 10.222.0.74 () {58 vars in 1235 bytes} [Fri Nov 19 13:49:47 2021] GET /compute/v2.1/servers/fef224f6-580f-4fd7-8f80-8e580dc79b2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 13:49:49.194528 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: DEBUG nova.api.openstack.wsgi [None req-fccd1a46-2853-428d-8cb1-0ac4fe807c0f tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] Calling method '.version_select at 0x7fb429b82820>' {{(pid=122814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 13:49:49.219827 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO nova.api.openstack.requestlog [None req-fccd1a46-2853-428d-8cb1-0ac4fe807c0f tempest-TestVolumeBootPattern-2002435482 tempest-TestVolumeBootPattern-2002435482-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-589091822" status: 202 len: 0 microversion: 2.1 time: 0.029763 Nov 19 13:49:49.221154 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: [pid: 122814|app: 0|req: 617/1223] 10.222.0.74 () {58 vars in 1259 bytes} [Fri Nov 19 13:49:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-589091822 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 13:51:07.030338 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:51:07.031074 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:51:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:51:08.804376 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:51:08.805394 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:51:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:52:23.494288 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:52:23.495216 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:52:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:54:27.056756 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:54:27.057420 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:54:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:54:28.827984 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:54:28.828688 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:54:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:54:41.032994 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:54:41.033719 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:54:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:54:48.503377 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:54:48.503921 dv-cinder-817351-4-iscsi devstack@n-api.service[122814]: Fri Nov 19 13:54:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 13:54:51.005882 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 13:54:51.006482 dv-cinder-817351-4-iscsi devstack@n-api.service[122815]: Fri Nov 19 13:54:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!